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This manual is , for the training supervisor, specialist or other 
officials who have to plan, develop and carry' through a training 
program for improving the ef f ectiveness^-bf the emploj^'ee dev^op-^ 
ment program. 

This manual is not intended to be regulatory or directive in 
nature. Rather, it is a guide from which each acti\^ty may choose 
whatever material ^.t believes*"may be 'beneficially applied to its 
own training problem. • . » • 



1. What is Employee Training? 



A definition that^' has become almost: standard is, "Employee 
training is the process of aiding' employees to gaini 
ef f ectiveness ^in their present or future work through. * 
the development of appropriate habits of thought and 
actiot^Si skills, knowledge and attitudes." ^• 

In any orgahizatioa, training goes on all ^e time*- in 
classroom, office and shop. Somehow new workers learn 
their jobs; employees increase their . skills ; people ^ 
*learn to* work togethfer. Hbwever, this learning may be 
hit or miss, sJLo'w*or fast, right ox wrong. Training is 
the conscious efrort on the part of management to,-give 
direction' and assistance to this learning. 

It is more than class or conference room instruction, 
although formalized group instruction is an important 
part of it. ^ ^ » 

* Training is the whole g^ut of activities connected with . 

the occupational development of people at work. 

A training program is the planned sequence of actions 
taken by an organization to develop its employees. 

2. Training in any J)epartment of Highways 

The objective of employee development within the 
Department is to improve the efficiency and economy 
\^ of ope;rations by: 



Developing a well-trained work force; 

assisting em^^yees toward achieving their 
highest potentS^al usefulness; and ' , 



- c. motivating employees and stimulating a sense 
of participation. 1 V 
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Training in and for itself has no place in the Government 
agencies. Training must have ^ p\jrpose; it must be-matched ^ 
irtdividually to the occupational 'needs of the employees and ^ 
collectively *to the organizational needs of the act;Lvity. i 

In the chapters that follow, we will consider the'^^ecessary 
fotindations of a good training pro&ramj how an agency determines 
what training is needed ;^ how a gaining program is Qonstruoted on 
the bafeis of these needs, and how an agency can evaluate- th^ ^ 

e^^ctivefie^ of its training program, \ » 

O - 
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^ ■ CHAPTER I . - . : J 

^ * • Identifying Training Needs ' ^ 

• * » • * ' 

1- Whose Business? ' * . 

Train^p^ne^ed' identification is,»in f act , ' everybt>^3 ' ^ 
busines^rf Xhereby, it ihay easily become nobodys ' business,^ 
'with guesswork -and unfouhded assumptions substituting for 
realistic analysis/and definition. /To ^event 'this - 

a. Operating officials must analyse their situation^ 
^ and decide whenXtraining will help and who needs' 

^^training. But tttey may need how-tordo-it lielp 
, from the traininj^ officers of persons responsiljle . * 
for identifying training needs' ^d .devefoptng 
training programs. * ' 

» 

♦b. Training Personnel must provide operating officials 
V the help they need and, if necessary, stimulate ^ 
action on their ^art including "recognition qf the 
' obvious needs listed below. Personnel responsible * 
^or training must get out and talk with gp^rating 
officials, get to know and understand^t|ieir problems 
as they see tViem. Only then can the trainir>g*^ 
personnel be cff redl assistance. 

2. Some Needs Are Obvious ' ' 

Existence of certain training needs can be accepted on the 
basis of common sense and reason, without extensive surveys 
or analyses. Training of some kind (fotn>al or informal; ^ 
simpleloT complex; by fellow employees, supervisors, or 
^others/) is a practical necessity, for example, whenever: 

a. a new employee comes to work; 

b. an.^^byee is assigned to a new or different 
joB which be does' not know; . ^, 

'the meC'tiods of doing an "old" job are changed; or 

d. the mission, -the organization, or the W9rking 
relAionship within an organization are sub- 
stantially changed/ , 



•The problem with suqh training nee^s is^ot. one of 4denti'- . 
^^.cation but one of. making' sure they are actually met* What 

plans do we h^e in effect throughout 'f he Department for>^ 
^meeting them? If each District or Division, etc,, Jias'^a plan; 

how- well does it work? , / • , . 

^' n 

Others Are Not Obvious • 

... / . 

Other i^rainiYig needs are not so obvious^. They laust be -aiTrived 
at through careful analysis,-base3 on problems existing 'or 
foreseeable in the work situation; This^iialysis should 
inclu^^ institutional as well' ak individual vemployee problems - 
a twc^*pi;Quged approach. It should be participated In to*' 
varying degrees by employees, supervisors, top management, 
and^ the personnel and/br training staff, each of whom can 
^make a different contribution. This concept of <;:ai.nlng nee^ 
identification is charted on Page* 7 followed by broad general 
guides for action. 

The Basic Process 

The basic process for identifying training needs appear^ 
simple: Determine what.-i^ expect^ or required in the job ' 
oV the situ^tiin. Determine the degree to which the Require- 
ment or expectation is *be.ing met . If it is* not being met, 
find the reasons.^ 'To the extents that these reasons involve 
changes in the knowledge, skills, attitudes, or behavior of 
em^/loyees. (at any level), we may have Na need which training 
can probably^ help meet. The Training P^sotinel and the line 
officials concerned .will have to judge whether tra^ang is ^ 
the best way to meet it. ^ / 

The simplicity of the process is deceptive, becaxise so many 
of the determinations are necessarily subjective. They aust, 
therefore, be made with special care, based on good information 
adequately interpreted ,and evaluated. V 

Gathering Data ' * 

How does one get the information necessary to make these 
determinatibus? This, too, is simple - in its basic aspects: 
Ask' line dltficials, staf? officials, employees. Observe- 
"employees and their work. Study production and other manage- 
ment data. Or use some combination of these approaches'. 

Specific methods of askingy observing, and studying are many 
and varied. The charts on Page -9 lists advantages* and 

' ' ' K ' 



limitations-'of each of these methods , With suggeste'd *^Do>'s 
and Don'ts" for using them. Earch of «ie .methods is then 
discussed in more detail, with sampl^# 'Ibis material is 
int;ended' not to prescribe or^ instruct But to, illustrate ; 
to describe a variety of methods which might be useful; and ^ 
to stimulate your thinking about what would' be most likely to 
succeed in your dwn situation, Xpu are urged to Accept, reject 
ox adjust any of it as necessary tc^ meet your own^unique . 
requirements. 

The kinds of things to be asked about observed , 'and studied 
as clues to possible training needs are also suggested by 
the discussion of methods and by the examples given in that 
di'scussion, 'These "need indicators" are summarized het^e for 
convefiience. 



STUDY 



ORGANIZATION PLANS 

* projected changes 'ih. mission;; 
^^^i^cture , personnel, or 
procedures, * 



EMPLOYEE RECORDS 
high turnover ' 

* absenteeism 

* sick leave rates 

* accident severity and 
frequency -ratios 

* ' tardiness 

* 'grievances 

* merit ratings 

* composition of supervisory 
force V 

official" inspections REPORTS 
^ by ovm organization* 

* classification surveys 



WORK AND WORK-FLOW 

* production bottletjj^cks 
fluctuations in production 

* reports on public or 
custorttwr satisfaction with 
product or service, 

* backlogs and where located 

* records of high cost,- 
waste, excessive errors* 

SUPERVISORY SELECTION POLICY ^ 

* qualification requirements 

* experience and training 
backg;:ound of present 
supervisors 

/ 



OBSEKiTE 



MORALE FACT0R3 

* personal' friction 

* '^buckpassing , • 
*\ complaints 

* inattention to work 



* leadership not held by ' appoinjted 
leader (the supervisgr) 

* supervisory ineffectiveness in ^ 
providing subordinates with 
sehs^ of worth, belonging, and 
security K 

* lack of supervisory support af 
subordinates 

I authoritarian leadership 

* absence of sense of purpose 
and accomplishinent 

* etc, . * 



JOB KNOWLEDGE 

* tethnical phases 

^ administrative phases 



supervisory phases 



COMMUNICATION FAILURES 



* written and oral instruc- 
^ tions -raisunderstood 



failure of informat^'on to 
flow up, down, and across 

inabij-ity to express, ~ ' 
orally or in writing 



* semantic difficulties 

POOir SUPERVISION 

.* assignment of work 

* planning and scheduling 

* ■ instructing subordinates 

* handling grievances 

* lack job pride , 

*^ poor coordination 

• / % 

* itiadequate recognition 

* failure "to motivate-- 

JOB APPLICATION 

* putting knowledge and 
skilj- to work ^ 

* will to improve,, self-., 
dev^lbpmetit 



The above factors overlap between 'groupings / Note the similarity 
between factors studied in needs analysis and those studied ip^ thq 
evaluation of training- This is because evaluation is the apprai-sal 
of how well training has sati^ied 5^nd needs. 



TRAINING NEED IDENTIFICATiaN 



Based on 



I. Analysis of Organiza- 
tional Problems and 
Conditions 

and 

II. Analysis of Employees' 
Performance, Problems, 
and Potential 



As discovered by — 

Employees 

A. Asking — Supervisors 

Top ^Management 
Staff' Offices 



B. Observing 



C. Study itig 



Einpioyees 
— Their Work 
Work Flow 
Rel'ationshipsj 



Recc^rds and. Reports 
Public Re'action to 

Service - ^ j-. 
Jobs (Job Analysis^ 
Organization 

Structure ^ 
Program Plans 
Orgofliaa 



4. 
5. 
6. 

7. 
8. 



To determine — 

What is the problem or 
situa'tlon that makes us 
want to do something ?^|||^ . 

What causes this problem 
' or situation? 

Exactly what do we 
really want? 

,What do we have now? 
4 

What do we lack? 

Which of these lacks, (ne^d 
have greatest* priority? / 

What can we do about .them? 

. How stiall we go about 
doing it? 



A. COOPERATIVE EFTORT^OF EMPLOYEES, SUPERVISORS, 
. MANAGEMENT AND TRAINING STAFF' 
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General Guides • - 

Each group must identify its own training needs^in relation 
to its own situation and problems'. , ^ 

Kequi;?fements' of operating progrdme- should ^fe the' major v 
• determinant of training -needs*" Needs of individual ^^ployees 
•^inusj:, of bourse, be 'cousidered and met - but within a frame— 
iwork of org^niz^tlouaL needs.. This' requires'^ study of org^ni- , 
zational and Operating problems as Well as appr^^al of 
peirformance and' potential of individuals. 'J ^ , 

Training need identification is a line responsibility.^ I^ltle ^ 
off icials mus t"^4dg*yt if y^ and analyze operating situations that * 
need im^rov^ent , aetetmine ,the changes required and decide ^ 
what actipn will best accompiish those changes*. -Traljiing ^ ' » 
Per sonnel can and should' help them .on methods and approach. 

Officials' at everydevel should participate ^fully, and* employees^ 
should usually .^participate, in defining traiAing neede . ; This is 
the best way toV^aaSure that^action^s directed at proljlems, 
and that training is a proper solution to tho'se proHlems/"' 

Conclusions aboat "The Answer" should,. be checlOedr^ Training 
isn't the -best* or even an acceptable, solution to every pro- 
duction and human ijalations problem. Weign carefully the 
probabj-e suecess, cost, an^" administrative feasibl-lity of other 
forms, of action before deciding to train, * « * 

* **'*"*.,^ * 
A clear statement of ^what training isnexpected to, accomplish 
should' be prepared; ''in writing and in advance. M wil], c<5nstitute 
the specific otjectives of the training, effort. I^shouW b^ as 
specific as possible, to guide selection of training constant and , 
method and to be most useful in appraisal of training results. 

Available training ^i^ources should be pinpointed on^actual,' . * 
pressinjg, agreed upon needs,. The day of training for the sake 
of tradiiing, or because everybody else is. doing it, shqu^d be 
lon& paSt. . ' / 

V 

Training ^eed 'determination is necessarily a dorjtinuiftg process. 
Needs - organisational and pei^sonal chafige cDn3tantly, are ^ ' 
influenced by many things. I t^^ia necessary to keep checking, \ 
keep analyzing, keep, revising specific trtkinj.ng' activities and 
goals, to keep them, related to actual problems and current needs.. 



SUMMARY-GENERAl METHODS OF NERD DETERMINATION 



METHOD 


' ADVANTAGES 


LIMITATIONS 


DO'S AND DONT'S 


-INTERVl1|/ 


Reveals feelings, causes and possl* 
ble solutions of problems as well 
as £accs. , 

Afford maximum opportunity for 
free expression of opinion, giv- 
ing of suggestions'^^ 


Is tlrae-coaaumlng, 'So can reach 
* relatively, feW people, 
R'esults may be difficult to quan- 
tify. 

Can make subj^ect feel he la "on 
the sppt." 


Pretest and revise interview ques- 

tlpns as needed. 
Be sure Interviewer can and doea 

listen, do»iii't judge responses. 
Do not u^ toi'lnterpret^ aell, or 

educate. * 


J 

QUESTIONNAIRE 


i ^ ' ; < 

Can reach m^ny people In shoz;t 
time. 

•Is relatively Inexpensive.' 
Olves opportunity of expression 
without fear or tisnbarrassmen^. 
Yleldar data easily summarized and 
reported . 


Little provision for free ex- 
^ pression of unanticipated 
responses. 
. ^ May be difficult t^ construct. 
Had limited effectiveness In 
getting at causes of probla&s 
^^nd possible solutions. 


Pretest and revise questions and, 
f otm as JJce^d. - ~^ " 
0*ffer and safeguard anonymity. 
Use only If prepared to: • 

- report findings, both favorable 

and unfavorable. 

- do something about^then. 

<^ 


TESTS 
i. 

GROfP PROBLEM 
ANALYSISv 

• * 

t 

% 


Are useful as jdlagOostlc tools to 
, Identify specific areas of defi- 
ciencies. 

Helpful in selecting from among 
pi)tentlal trainees chose who can 
dost profitably be trained. * 

Results ate easy to compare anB 
report. 

. Same as for Interview plus: 
Permits synthesis of different 

viewpoints. 
Promoted genetal understanding 

and agreement. « 
Bullda support for needed train- 
ing. 

Is In Itself good training. 

» 


Tests validated for many specific 
sltuatlona often not available. 
' Tests validated elsewhere may 

prove Invalid In new situations. 

R^sult^ give clues, are not con- 
clusive. Tests are second-^est 

, evidence In relation to job per- 
formance. 

Is time-consuming and Initially 

expensive. 
Supervisors and executives may 

feel too busy to partlcipats, 

want vork done for them. 
Results may bi! difficult to 

quantify. 


Know what test ^measures. Be sure 
It 1% worth measuring here. 
• Apply VMults only to fittors for 
which test la good. 
Don't use tests to take blame for 
difficult or unpopular decisions ^ 
whlc^ management shosld make. 

Do not ipromlse or expect quick 
results. ^ 

Start with problem known to be of 
concern .to group.' 

Identify all problems of signif- 
icant concern to group* 

Let group make own analyala, aet 
own prlorltlea. '' 


JOB ANALYSIS 

*ND PERFORM- 
^ ANCE ^REVIEW 


ProdiJCes specific and precise 
Infonaatlon about J[obs, per- 
formanc^t - 
Is directly tiad to actual ^oba 
-and to on-job perfon^nce. 
^Breaks job Into aegmenta manage- 
able both lor training and for 
appraisal pyroses. 

1 \ ^ 


Time-consuming. 

Difficult for people not 
specifically trained In job 
analysis techniques. 

Supervlsora often disllke^^ re- 
viewing enfloyees' Inadequacies 
with them personally. 

Reveals training needs of Indi- 
vidual? but not those based on 
ne^s of organization. \ 


Brud|i up on job-analysis tech- ^ 
nlques, "^rr^nge special traln- 

, ing for thdse who are* to do It- ^ 

Be sure analysis Is of current ^ 
job, and current performance. 

Review with employee both — " 
- analysis of job, and 

' - apprals'al of performance. 


RECORDS aAD 

REPORTS 
' ^tUDY ^ 

y 

% 


Provide excellent clues to trouble 
spots. 

r ' Provide best objective evidence of 
fX ''results of problaps. 

Are usually of concern to *nd 

easily undarstood by operating 

officiaXa. 

* ^ 


Do not show causes of probleoa, or 
possible solutions. 

May not provide enough cases 
(e.g., grlevancca) to be mean- 
ingful. 

May not reflect current aituation, 
recent changea. 

P ' 


Uae as checks and clues. In coabi*- 
nation with other methods.^ « 



Methods 



Interviews 

Better .tKan'^tny other device, interviews help those 
interested in training understand how people feel and '\ ■ * 
why - understanding crucial to success of any effoft ;• •* 

to bring about change* They also demonstrate, in ^| 
personalized way, sincere Interest in wHat people / 
the work group think* ' .^ 

One limitation of interviews is that^ they 'are time 
consuming and so can reach relatively few people* . 
Mso, tfiey may be difficult to quantify^ quantification 
usually requiring construction and use of' some system 
for coding responses* 

Interviews can be ag fnformaJl as- a lunch-table discus'sipn 
of office problems in which one •remembei's what is^said. 
Or they c^n be formal encfugh to involve a form on which is 
written cfo^ on the spot, 'subjects* responses »£o a p.re- 
detflroinedrlist of questions. • ^ * 

Open-ended, nondirective interviews*ara more^valuable 
than other kinds, for getting at feelings and attitudes ^ 
and at ^le causes of problems* But they yfield les^ 
uniform and less readily , quantifiable data than do ^ \ 
controlled interviews'* Results- of the lattfer are'^e^sW ^ 
tp process but may not be as valid, for*- their very structure 
'tends, to restrict and to in f lu^ ce the responses' given. 

Naturally, the more skilled the interviewer, both in 
asking and in interpreting responses, th# more v^luable..,^ * ' 
the data he will obtain. SO try out' your questions in . 
advance and revise them if necessary to get J:hejn clearly. - 
understood; allow your subj ects^anf^Jle opportunity to talk; ^ 
unhurriedly; concentrate ondTst^ning to .what they are 
" really saying; do not make/\^lue judgments" oi\.^their 
responses; and do not use' the interview to interpret, sell, . 
or educatfe. In cas^ ypu feel dubious about your i-nterviewing 
skill: any Information you get will be better 'th^ none, you 
will learn a lot in the process, and your interviewees will ' 
have an opportunity to contribute to the' solutitJit of mutual 
problems. ^•^'aw ' * ^ 

Direct questioning can identify certain traiiilng- needs. , 
Here is an extremely eimple application of this method. 
A. representative s&nple of both supervisory and non- 
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supervisory' employees iS'as visited by a "pollster 
He asked one simple question: "What do you think 
your supervisor^needs training in more than anything 
else?" Replies were recordW and tabulated^ a .frequency 
distribution took shape, and the company soon had aiv ^ 
excellent picture of its supervisory training needs as 
seen by those supervised. 

■ « 

On the other hand, you may get more accurate and mpre 
useful inflSrmation if you ask your subject about his 
problems, rather than what training he needs. On the 
basis of what you learn, you, can then determine with 
him whether training is needed - and if so, what kind. 
For example: ^ 

Ask employees . . 

* How do you feel about your job here? 
*' What do you like most^^about' it? Leasj:? 

* What pa3rt(s) of your job give(s) you ^ 
greatest difficulty?^ 

* What is t\ie effect of this Jifficulty - 
on you -peifsonally? on your supervisor? 
on the department? 



What is the cause of the diffici^ty? 

In wha^^s 

want t^improve? 



ispects of the wo 



diff ici^ty? 
rk do yfu most 



* What are you actually doing ^to try to improve? 

* Do you need additional helpT. What kind? 
From whom?- 

Ask supervisors 
\ 

* What^^ire the areas in which you most want your 
staff .to improve? • 

* What are the problems in trhese a^^s? 

* What is'th^ effect of these problems on the 
Department programs? 
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Wh^t is it^that you \^nt your-^gtaff to,be able 
to do that' it does not now do as well as you 
would like? \ . 

* What are you doing-w^o help them* improve? Do 

they need additional hplp? What kind? 7rom whom? 

* To what extent do you "^gree with your employees' 
analysis (see abovet ) . ' 

Questionnaires ^ ' \ ' 

^ ^ . ^ % 

Written questipnnaires are also useful tqols for gathering 
inforwtion from which train^ing needs may be derived. 

Qlies tionnaires can reach many people in a 'short time, 
Usually at reasonable expense. Lik^ interviews, they 
giye people' an opportunity to express their ^feelings — 
in this case anonymously, without any of the embafrasgment 
or anxiety which can accompany the more personal techniques > 
WeU designed, they yield data that caii be processed Quickly 
and ysed sta tis-tically / ' ^ . 

J-/ 

A llJDitation of questionnaires is that t^ey get answers oAly 
to the ,questions that are asked,^ affording less opportunity 
for free expression of unanticipated kinds of responses. 
This puts -a premium -^n knowing what to ask and how to ask / 
it. Por this reason, questionnaires are best constructed j 
after a few intensive interviews have been made' to provide 
a framework of contents . ' ^ « 

Questionnsflres'^lso' have llmiteci effectiveness in getting 
at causes of problems *and the best t^ourses of action to 
solve the problems. For this reason, they should usually ' 
he followed by a few intensive interviews. 

Any questionnaire,-' like agy interview, should be pretested 
and revlsed'^as* necessary ^or clarity, adequacy »of coverage, 
etc. „ f ^ • " — ^ 

Anonymity must be safeguarded — and participants must hd 
confident tha^ i^ wi^ be safeguarded^ 

ONE CAUTION — Questionnaires are mass communications media. 
They reach many people in. a formal way, and •fcbese many people 
who check or. write down their answers to ybur questicuis will 



12 



w&nt to know what you find out and what yoii do about it. 
Vae this technique only if you are prepared (a) to report 
your general findings .to those who participate, and (b) 
to do something about your findings.- 

The Employee Attitude Survey is a specific application of 
the qu^tionnaire technique. Such surveys usually inciud 
some questions bearing directly- on training, and ^9wers 
to other questions frequently prodtjce additional clues oti 
training needs. For example, see the ^following excerpts: 



■ t 
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EfTPlOYEE i^vTTITUDE* SURVEY- 



" (date) 



(DivisiortV District, ReSi-dency, etc. J is interested' iti knowing 

how you about ^this agency as a>lace tt> work. We would" 

like to find out What things you like, what things you feel like 

changing and what Things youf think. would help mak^ yoiir work here 

more satisfying and productive. If you will answer these questions, 

we will haVe a better Idea, of how you feel .about these things^ than 

we can get pthetwise.' * ^ ^ ' ^ 

Hark only one answer GO, each'^ question, unless you are asked to ■ 
gi-fe moi th&n one ankwer. You do not need fo. sign, thejiuestlonnaire 

or otherwise identify yourself . • 

• * - > 



4r 
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How do 



|you feel afeout the importance of your /Work? 



Very important 

Important 

V . 

Of little importance 
* I 

Of no impor trance * 




r 

What about the indoctrination or 6rtfenl;^tion given'" you b)f this agency 

• . \ ' - ' 1^ ■ 

, X^ever received any ^ . " 

=" — ^ , (« . 



j_ Not enough^ - * ^ 

About right - ' ' 
Of^ no importapc© • 



r 
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How about the training made available to yot» by thif ♦agency? 
Too- i^uch training 
yight 



- ^ • 

' • About, i/ight 



Not enough 



Do' you think more training would help you do better work in 
your presrent ''job? ^ * ^ ^ * , 

No *• / ^ . Yes 

.1 ■ . c 
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If yes, chk^k wl 



yes, chifk which . ^ % 

Training iiy ag en policies, p^cedures and 
regulations ^ 

Training in how to ^r§pare agency correspondency 



Training in-how to-be a better supj^rvi^or^ 

' Vraining in skills or subjects related to your . 

work (either ^n-the-job or classroom training) 

How well does your iimnediate supervisor -plan the work of your 

departruent? . • ' ' . 

t ' 

There, is xio planning 



4 

.Occasional plarfning, . but not well done 



» Work 'is regularly planned 

Careful, systematic planning and follow-up . 

Do you likfe to be kept .informed as m how well you are doing 
in your job? 

y ^ 

Definitely, yes * 



I suppose I do ^ ' 

Not especially; I know how I*m doing. 
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Do you know what your^ supervisor thinks of your work? ^ 
• ' *Yes 



I think I ^o ' ' 



^^I'm doubtful 



I don't know 



How much instruction do you get on new work or new methods'? 

• , -. ( 

_^ .Do'not ne?d iftstruction 

,/ 

All I need ^ w 



\ 

Almost as much as I need 



Not as much as^^ I need 



When a change occurs in your^work, are the reasons for it 
explained to^ you? 



Always, 
Usually 



StJine times' 



^ Seldoift 



\ 
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To what extent does your supervisor encourage you to -make 
Suggestions?^ 

Often 



u 



Sometimes 

Seldom. 

Never 



3 



Do you feel that goj^d suggestions get adequate cpnsideration? 

^ " Yes iJp " 

Does your immediate supervisor keep, you informed ahout policies 
and practices? * , 

J Always 

' Usually . . ^ ' 

' Sometimes 

Seldom * ' ♦ 
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The Supervisory Improvement Needs Survey technique appeal^ 
tb many who fear that the usual employee attitude survey 
* directs thinking too 'negatively. It is rejported in success- 
ful use by such companies as the Texas Company,' Crown Zeller- 
bach Paper Company, and others. It is equally adaptable 'to 
surveying non-supervisory training needs. . 

Potenti-al trainees are given a list of possible training 
subjects, with a brief description of content, and asked 
to indicatg theii> top three preferences.. 

The advantage of this approach is said to be its positive 
.and constructive emphasis, which gets the trainee thinking 
in terms of what he wants to help him do a better job, faster 
or easier. It may, however, tend to limit the range of chpic 
expressed by trainees, and it may influence them' to choose 
subjects they think they ought to choose or that management 
wants them to cboose. 

The Slip Survey 'Technique is an interesting device which 
might be considered a form of questionnaire. 

Potential traiji^s are called together in groups, given 
cards or slips of paper ,^ and asked to record, as fast as 
the thoughts occur to them, what they consider to be their 
greatest difficulties on the job ~ one difficulty per slip, 
expre'ssed in "how to" form. ' That is, "how to discipline an. 
employe^," "how to write a report," "how to reduce the number 
of errors in my wor}c." The slips are then collected, sorted, 
and analyzed for twining needs. This technique get^ a 
considerable amount of material ^n a short time. ) It may, 
however, be somewhat ' superficial and. therefore needs to be 
supplemented by other methods. 

Records ^nd report's analysis 

Management records and reports ican also provide valuable 
clues to training needs. It is desirable, for Sample, to » ' 
study^ inspection reports, personnel records*(grievances, 
turnover, absenteeism, accident frequency and severity, 
tardiness, suggestions and awards, etc.), cost and pro- 
duction records, etc. Since such records seldom reveal 
causes of^ problems, however, they are best used as supple- 
ments, to and checks on other kinds of need determination. 
They are, in other words, ciues to J^e followed up. 




Tests \ * _ / ■ 

Tests of varictus kinds raay.also^be us'^d ii\deterTnining 
traifiing needs ~« and, once an area of need has been found, 
-ifi, selecting the employees to be trained. They can be 
especially helpful in determining whether the cause of a 
recognized jproblem is a deficjtency in knowledge, or sk4.ll, 
or attitude and, 'therefore, what kind^of action 'should be 
taken/ > • - * *^ * 

Performance or achievement » tests are essentially means of 
sampling what employees know or can do, and can therefore 
help to locate areas in which more information or more skill 
training needed. Aptitude tests indicate potential to 
learn or' acquire ir^formation or skills in a particular area, 
'and so are useful in selecting from among a group oi employees 
those^ho can most profitably be trained. Trade information 
tests are used to determine levels of knowledge and skill in 
a variety of occupations. 

It is tr'u*e that tests sample learned ideas or facts or 
attitudes which may or may not be carried over int% practice 
on the job. This does not, however, invalidate their 
^•"sefulness as diagnostic tools. For unless the necessary 
knowledge, skills, and attitudes have been learned, they 
can hardly be applied on the Job.^ And if they have haan - 
learned but 'still -ar^^ not applied, additional training in 
what has alrea^dy been learned but is not being applied is 
not a suitable remedy.. 

Special suggestians to those who would use t-ests a^ aids in 
diagnosing training needs: ^ 

* Be sure that you know what the test actually measures, i.e. 
knowledge, or skills, or a^ttitudes, and in what area 

* Be sure that what it measures- is relevant and important , 
in the particular situation in w?>4,ch ,it is' to be used 

* Be sure that ^^he re^sults of the test are not generalized 
to apply tp ai^as to^which it is not relevant 

* Try to cross-ch^ck the* results (as with other methods). 
The Training Section can advise you about the availability 
and the value of specific tests' for use in determining 
training needs . " * 

Group analysis by the line 

Group problem analysis, in which supervisors analyze^ together 
their problems, is an excellent means of determining training 
needs. 

20' * ' ' ^ 



Groups of. suj^grvisors in a given Division, Disttrict, 
Residency, etc., -for exampi^e, might get together^. — yith 
or without a training specialist — to discuss their 
problems, to analyze the causes of theCe prdblems, and 
to decide what changes ^are necessary to s61'v^ Jjk^ problem. ' 
Some of these clfiang6s may be" accomplished through straining, 
-Others through mother manag^ent actions. * i 

. . - • V • ■' 

This process ndt only -identifies training ^among other\ 
"Reed^, but also builds a solid founida^ion of support f<|r - 
(raining .decided on* " (For tt^permigs those immediately 

'concerned bpth to establish the -ne^ for. and help decide 
what training should be given.) In addition, the process 

^rtself is training which helps participants- become more 
^analytical in their study of probl^ns, gives them an 
opportunity to rais4 questions, make suggestions, hear 
other participants' viewpoints *and suggestions, ai/d help 
each other. -r'- ^ 

Any staff man who participates in meetings like these can 
facilitate discussion, help members clafcify their thinking, * 
and- advise on what training can and cannot do. Bu^ again, 
he^'^tfoulSn' t make value ■judgmen'ts^and^ he should b^^ery 
careful. not to direct members ' conclusions.' ' 

Sucb jues tioni^afs those shown below and or^ page 21 might 
well De asked when this process is used at higher levels.* 
Here it has the special value of getting' top-level management 
agreement on what kinds of, people are required agreement 
that becomes -an* invaluable guide to any training effort, 
esprfially^ where the qualities desired are not generally 
known or clearly pnder stood. On page 23 ^there is a suggested 
outline for a single supervisor's ^W.f -audit of his program 
and its needs. This outline can just as easily be used as 
• a guide for'^roup "stock talj^ing." ^ ' 

Group 4ispussions of |his kind may be quite extensive >artd 
detailed, requiring a great deal of supporting staff -work. 

V this is not pi^actical, they may be restively simple. ' 

fche^ Important thing is that manag^ent ga through the thinking 
process and reach realistic conclusions, based on' the bes't 
available ihf ormation, , on the ^questions raised. 

QUEStlOI^S feOR GROUP DISCUSSldN LINE SUPERVISORS 

Why are 'we doncerned about tral'rfLng? 

What are the problems that mak^us want to do something? 
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Wh^t are the results ofjthese*on our programs? 
Our own operations? Our .stscff s? ^ 

What should be the* obj ectlves of our training program? 
.. ♦ * * ' • 

What do we really want? 

V 

What do we lack- — asv specif ically as possible? 
Which. of these nfeeds (lacks) are of gi;eatestr priority? 

Which positions are of key Importance to the success of 

our program? ' ^ 

' ' • , »• ' 

What major, responsibilities and duties go^'&sJ:i» these 

positions? * ^ ^ ' 

What technical -and professional skills are needed? 
N * • ' • 

What is the size of our need for replacements (present 
and reasonably foreseeable future) in these jobs? 

What will be the result, of any changes in objective 
or program? 

What will be ^the tesult of any Departmental contraction 
^ or ^^aneion foreseen? 

What chain reactions will be set up by ?:etirefcents from 
key positions? 

. ^ ' ' ' ' 

What kinds of people^o we want in these }cey positio'ns? 
What qualities and experience are needed to assure success 



What type dl^p.ea4er ship do urer want? 

Do we need people with field experience? Line or staff 
experience, .or both? Generalists? Specialists? Some* 
of each? If so,, in about-what propcrtion? , 

What program attitucjes do we expect? 

How can \^e get these kinds of people?. . ^ 

■ Have we valid means of determining th^ presence or 
absence of the 'qualities and skills we seek? . ^ 

22 , , 
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; How can we best appraise employees* "^performance? 
potential? • ^ 

What promotion .lines do we need? For professionals? 
For supervisors and executives? For staff ' assistants 

Hov*shall we decide what individuals should" be developed 
^or what purposes, and how?^ 

What methods of developmentv.^hpuld we consider? How should 

we combine these to get best i^e^ults? How can we improve 

the effectiveness o£ "training by'-'^^perience?" What* part . ' 

should more formal methods play? At what stages? What can 

be obtained from our personnel; and training staffs? elsewhere? 

The supervisor who asks himself seriously and cons'cieatiously 
such questions as those listed below will have a much clearer 
idea of ^ his actual problems and needs and a greater ability to 
choose the best course of action. 

QUESTIONS FOR>AMLYSIS BY LINE SUPERVISOR 

What was^my program expected* to accomplish yihen It was 
originally set up'? By whom? In what length of time? 
Was this expectation realistic? ^ 

Does the need the prografii was established to meet still 
exist? us it of the same nature^ scope, intensity? What 
is the evidence? Do all those ifaportantly concerned agree 
on this iieed? 
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What Has thd program actually accomplished in the last two 
or three years? Is this more or less than it was expected 

fby me, by my immedia te. ^^^itfervisors , by the Department) to 
ccomplish? *^ Were these Qc|'fe<^at:ibns realistic? 

In what ways has the program fareen particularly successful? 
Why? In what ways has been -disappointing? Why? * 

Have ahy. of the disappointments -been due t-o personnel problems? 
What kinds of personnel probJms? How serious? What is the 
evidence? ' . . .i* 

What kinds of steps can be taken to, solve or to reduce the bad 
effects' of these problems? ^ Whe^^--fiteps should be taken? How 
does my conclusion on this jioint compare* with that of any group 
that may have made re commend^ ions about or directly rej^ated to 
my operations or staff? Do^ available management data su^^port 
my conclusions? 



If training is on^ of the steps to be taken; ex^tly what 
could I expect lit to accomplish? Is this expectation 
reaeonalle? Would the^reeults justify the time and effort 
required to train? How can I cheeky this? 

Job analysis and performance review 

,Job analysis combinefl with performance appraisal is an ^ 
'excellent method of determining training n^eds of individuals- 
The process, briefly, is: determine the specif ic j^i«e of 
the Job; evaluate the adequacy with which the employee per- 
forms each of these duties; and locate significant improve- 
ments that can be made by trainings 

The list of duties .can be obtained in a number of ways: 
'asking the employee, asking the supervisor, observing the . 
employee, s^rveyiI^g job 'description, etc. Adequacy of 
performance can 'be estimated by the employee but the. 
supervisor's ei^|fegatJ.on must also ^e ol^aiaed* This , 
evaluation ^j^iiPlbually be based jJn observation* 

What does the supervisor observe? .The employee, while he 
is working, the work'produced; the employee's work relation- 
ships. The ease, the speed, .the -sur eii^s', tthe safety of the 
employee's actions, and the way h^ applies himself to the job. 
The accuracy and the amount of completed work, its conformity 
with established procedures, and standards, its appearance, 
and the soundness of judgment it shows,. Any signs of good or 
poor corampnication, understanding, and cooperation among 
employees. 

Such observation is a normal and inseparable part of the 
everyday job of supervision. Systematically recorded, 
evaluated, and summarized^ it highlights both genetal and 
individual training needs. • ^ ^ 

-Below is. an adaptation of General filectfic's form— one for 
each employee— on which the supervisor records results of 
this kind of job analysis dnd p«rforpan'ce appraisal. On it 
he notes the responsibilities of each job and for each of 
these responsibilities : thf factors of aceountabiUty, 
(performance standards), adequacy of perform^cfe, causes 
of any deficiencies, training (or other) action needed, and 
sources of help needed .v Listed eCpaiStely are those training 
needs Wh^ch the employe^an aeet without help, those- which 
can be met with the supeWisdr.'s help, and. those on which 



special assistance is required. These forms' are 
reviewed by the central training -office, which * 
identifies and plans to meet special* training needs. 



(Nape) 



(Job Title) ' 

K 



(org'anizati9n. Unit) 




BESPONSlftlLITIES 



FACTORS OF 
ACCOUNTABILITY 



CURRENT 
PERFORMANCE 



CAUSE OF 
DEFICIENCY 





WHAT. 


- • WHAT 


OUTSfDE HELP' 




ACTION NEEDED 


EMPLOYEE 


SUPERVISOR 


NEEDED ^ 


PRIORITY 




CAN DO 


, CAN DO 


• \ 






♦ 









The Qr^.tical Incident Technique, is a job analysis and 
performance ervaluation device that places special emphasis 
on kinds of behavior^ that distinguish effective from 
ineffective perf orm-ance. Only the major requirements of 
^ the job thos^e that make the difference between success 
and failure — 'are -listed. Under each of tfiese are brief 
descriptions, usually in checflclist form, of observable on- ^ 
the-job behavior.. The superv^.sor checks- the forms to recoru3 
,his observations of each employee's, behavior, adding whatever 
explanatory note he^ feels nrfessary. • 

* Isolate and list ^ach individual duty of position. , ^ 

* Gtoup related duties into a classified li's^t. 

* Establish Che narture of responsibility for each duty. 

* Estimate frequency, importance, and difficulty of each. 

* Evaluate the^ employee* s performance on each.. 



* Check as training need^ any deficiencies whloh are y 
significant and which can be corrected by training. 



\ 
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The Appraisal Panel method, is being usa^ increasingly to 
identify training nee^s of supervisors. It 'is essentially ^, 
a process of supervisory o'bservation and evaluation, supple- 
mented** by the observations and .evaluations of others who*;"' 
personally know the appraisee arid his work. The basic steps 
are: ' * . 

OUTLINE OF APPRAISAL .1PANEL METHOD ^ ' v ^ I 

Appraisal > 

ApprOfisal is the process of ' ev^aluating an individual's ^ ^ 
capacity (a) to perform in his present position gnd (b) 
for handling more responsible assignments in the future. 
In this system, appraisal is carried out by a panel composed 
of the supervisor and two or three others who -are at his level * 
in the Department. These other panfelist^ are selected especially 
because* of their knowledge of the appraisee. 

Review , ' - 
/ ^ 

Review is the step iri vhich the supervisor reports the 

findings of his panel to higher management authority.' This 

step gives Jiigher-grade supervisors an oppprtunity to: 

V* Check on* the adequacy of proposed developmental 

plans for the individual appraisees. - ' ' ' ^ 

* Assess the total human resources now and ifi the 
future. 

* Identify individuals vf^^^ potential for more 
responsible positions. 



. J)iscussion 
— • \ 

Discus^sion is/the step in*"vhich -the supervisor counsels 
privately with the appraisee ori his strength? and weak- 
nesses and tries to motivate the appraisee to accept a 
development plan. 

Development 

Development is the step in whiclithe agreed-upon plan for 
fostering the appraisee's growtholp put irito effect. It • 
is' compounded of self *heXp , ^dep^r^nentai "support and guidance, 
plapned work experiences , 'and formal education and . training . 

14 
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\' . - ' : 

Analysis of Data * . t 

Regardless- -of the method by which infonuation is obtained, 
it must be analyzed (jdy training (and other) needs. This 
is a matter of reviewing, .classi^fYing, interpreting, and 
evaltia<iDg the data gathered and of judging what action will 
best ^olve the problems found. • ^ ) 

In making this judgment, It is important to consider all the 
alternatives (including their costs, practicality, accept- 
ability, and administrative feasibility) that might accomplish 
the desired result. Among the alternati^i^ that should usually 
be considered are r ea:ssignment , separation7""TJl: training of 
employees; selection of different kinds or levels of talent; 
revision of work assignments, methods, equipment, or relation- 
ships; clarification or simplification of policy, structure, 
ins trutt ions . ^ 

If the decision is to train employees, it is important to 
determine as accurately as possible whether the changes 
needed are changes in knowledge, or skills, or attitudes — ' 
and whose knowledge, stiills , or -attitudes. If employees (fo 
not know (lack of knowledge), cannot do (lack of skill), or 
do not care (lack of motivation) , they are obviously unlikely 
to behave as management desires them to behave. But it is • 
netessary to know which of these is the problem, in order 
train effectively. ^ 

>r example: If the trouble is that employees don't knciw what 
they are to do^ they need information, not attitude training; 
p^"P^ talks on tha importance of t;he Department '^s objectives are 
not likely to help much in thie case. .Jf they know but can't 
do, skill practice (or . r^eassignment , or ofher action) rather 
than information ^s' probably indicated. If they ha^e the ' 
necessary job. kn6wledge and- skills but simply do not care, 
additional training in job knowledge and skills Isn't likely 
to improve either tjieir performknce or thfeir morale. 

If all of these requirements are met — if employe^es know^^ 
can do, and are interested in their work, but sti^S^omot 
behave as management desir-es th«pi to — we have a problem , 
which cannot be solved by training these employees who aren't 
behaving's^s desired.- It is then necessary to consider such 
questions'as these: Are management's expectation's reasonable? 
Do such praAical^^imitations as lack of time, inadequate 
supplieg^and equipment, too many distractions and inter- 
ruptions 'make the desired behavior impos'sibla^ Has njanagement 
created an environment ox situatlon*in whicn the desired 
behavior would ^be rewarding? • . ' ^ 
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These are things about which management — line management — 
must do something. And the focus of its aV:tion should most , 
probably-^be the' situation or the group in which the employee 
works rather tlian the employee" whose- behavior was the object 
'of original concern. ^ 

All of these con^^jf erations , plus- other |5ractical ones like 
availability of staff and facilities must be kept in mind in 
analyzing the data and reaching conclusions. General Electric' 
Philosophy arid Approach ^or Manager Development suggests: 
• . ' • • , 

Think^ ahead*, before accepting the completeness 

and validity of the problem as presented. 

•Think whX)le, on the nature and relationships of 
the problem as realistically defined, and 

Think through, to th^ f ar-r-eaching implications of 
' the alternative courses of action or decision available, 
'in exercising balanced judgment to liake the best d^ecision 
in the ifght of the best^inf ormation available at the tira^ 



This 'thinking process 'should be a cooperative line-staff 
activity.^ The Michigan Survey Research Center's *'Feed-Back" 
technique of handling survey data can help make it so. The 
Center's surveyors make oral reports of their findings, with 
^ome tentative interpretations and Suggestions abo>^^t possible 
causes, to groups of responsible management officials. These 
officials discuss and evaluate the findings, check the inter- 
pretations, and make their own judgments and deai^ions abou-t 
the-a/tlon to be taken. ' / 

Whether or not you use a Michigan-style feed-back, remember^ 
that the more responsible and representative the people whcr 
help analyze, interpret, and evaluate data, the sounder and 
raore\iseful the resiilt^ and conclusions are likely tb be. 
While this process of ec^operative analysis admittedly requires 
time and attention^ it is your best safe^guard against un- 
justifiable expenditures and preventable failures. 
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CHAPTER II % 



Mee^ng^ Training Needs 



When training needs have been identified and agreed upon, it: is . 
time to consider training resources, adininistration^Jpontent , and 
method. A "reminder"- Cf major importance: 

^ * Training goes on all the time, even in the absenc^ • « 

of formal or planned programs- *^ 

Many training - resources^ are available and ordinary 
adminlfstrative processes can be^made to serve as » * * 

very Effective training methods. 



Methods and .Resources 



The following points illustrate the rich variety of resourdtes and 
. methods that shou'ld be considered in planning to meet training needrS, 
individual or group: 

* On the job Activities, e.g. . ^ 

Coaching by superyisor or co-worker 
Observing ^ ' 

- Delegation . * - ' ' 

^Sending Upstairs" 

trading Conferences ' 

Instructing Others ^ 

' - f 

^ « * • Broadened Experience, e.g. 

Guided Experience . - 

Job Rotation 
' ^ Multiple Management Participation i 

Understudy or Assistant-To Positions 

Participation in Policy Development aiid Work Planning 



"Filling-in" for Associates 



* Group Training, e. 
^ Orientation 



> Supervisory and Executive Development 

, Professional Training Programs ^ 

Skills Traina,ng Courses 
Conferences, Seminars, Staff Meetings 
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* Professional Actalt^ities , e.g. 

Membership and Par ticipation in Business, Trade, or. 
' - Professional' Organization Activities 
Attendance and Participation in OutsJ^e Conferences, 

Conventions', Workshops 
'Reading ^ - 

» 

* Outside Traijiing, e.g. 

/ School, College, or University Programs, or Courses 

Cofrespondenae Courses 

The .following list of major steps involved in planning and conducting 
training may serve as a guide for and as a check on the plans made for 
training: - ' v ' 



Major Steps in Planning and Conducting Training 

* 'State the general purpose and the' specific objectives of 
, ^ -th^ training to be given.' 

If .^^ossible, indicate the direction and extent to which 
trainees' knowledge, skills, or attitudes are to be 
developed. ' 

* Decide on the approach to be ta^en in introducing ^training . 

w - A safe rule to remember: Top management is not likely to 
.1^. ' approve training, other li^e officials are not likely to 

stipport it, and trainees are not likely to apply it on the'« 
^jt>b unless all of them see the training as a means of doing 
something tKey want done, in a way they think ^ill succeed, 
and without too serious conflict with other demands important 
to them.' 

^ * Organize for trainings 
I 

Decide who willdo the actual training and be sure, that 
they can do it adequately. Decide whether training will 
be on or off the ^ob, individual group; if group, whether 
^ seminar, workshop, conference, class, institute, etc. 

Decide whether coomittees will be used, who should be on 
thera, whether they will be advisory, directing or operating. 
^ Provide for follow up to^ encourage on-job application- of 

training. 

* petermine who is to be trained. ^ 

How many people. Ages, sex, special characteristics, general 
backgrounds, occupations, grade levels, training needs artd 
. interests, relationship to each other. Consider carefully how 
all of this is likely .to affect^the training. ^ 



Decide oi), develop, and organize training content. Sort ^ 
established n^ds into reiated groups. Select or develop 
coi^tent ap^Jropriate to meet these needs, using such sources 
as supervisors and employees, manuals and -other written 
Instructions, 'pertinent literature, research findings, work 
materials-, job analysis. , "Arrange . this material in coherent 
otder for learning. * - 

Choosy the training methods to be useci- 4 

Use in balanced va'Piety those methods that will satisfactorily 
achieve the desired purpose with the greatest" simplicity an<^ 
economy. ^ ^ 

To increase knowledge, consider especially: assigned reading, 
lectures, gy.ided d-i-s cuss ions , demonstrations, self-tests. To 
improve skiil, case studies, problem-solving conf erencjes , job 
rotation, supervised practice on or off the job. To influence, 
•attitudes, consider especially: role-playing, de^ions trations , 
case studies , ^Toblem-centefed conferences, job rotation, movies 
inspirational talks. * ' 

For any or all of these purposes supplement basic , methods 
with appropriate visual aids or devices and with follow-up * 
discussion. . * 

•Prepare instructional materials or guides and appropriate ^ 
time schedules. * 

S^e that all persons who are to give training are properly 
briefed and that they^ plan, and Jirepare in advance. 

Make and clear detailed arrangements. ' 

Arrange for trainees* attendance. Get space and equipment 
lined up, making sure that it is as ample, well-arranged 
and comfortable as circumstances permit. Be sure t^^at 
everybody will be able to see and hear. Arrange for 
'appropriate publicity, records and reports, recognition, 
of trainiees, ebc. ^ 

Give training. 

\ 

Start and stop on time. Make sure that discussion is in 
terms trainees can understand. Relate what is being taught 
to what trainees are interested rn . Encourage their 
participatj^on. Allow few, ^f/any, "sit-and-talk" sessions 



pa 



1 
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to tun longer than an hour or an hour and a half. Get 
itrainees* reactions and. suggestions , and .those of dis- 
cussion lead^s or instructors. 



See that' training is evaluated. ' ' c • ^ 

-Chapter III of this pamphlet which discusses evaluation in 
toore detail will, we^hope, help in the development of 'bette:j 
ways of evaluating training in your own situation. ' 



\ 
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CHAPTER III ' ' . ' - 

■ , . - • " ■ ■ I 

' EVALUAJiON 

I 

\ 

1. The Nature and Meaning of E>?aluation 

Evaluation, gome say, is the mosj: essential and ^ the most saSly 
^ , neglected phase of training. Others consider it unnecessary or 
even undesirable. Everybody agrees that it is difficult, and 
some maintain that it's impossible. Most take the view that* 
It j.s simply not done in the majority of the' organizations, 

19 * 

The truth of the patter is mat trainees and training activities, 
like aiL other emplpyees and\all other activities, are constarftly 
evaluated. Evaluation of somjp kind, formal or informal, is the 
basis for practically all a^lalinistrative decision and action, 
including decisions to establish, to -abolish, or to'change 
^ training programs. It is inherent in admin is tratioji, and we 
cannot avoid it even if we try. 

' The question, then, is not whether to evaluate, but what to 
evaluate and how to'do^it better. 

2, Evaluation is Judging ^ 

Evaluation is, quite simply, an appraisal or judgment of the ^ 
value or worth of something, 

I, * * 

It i3j^;^ft?jt necessarily expressed in monetary or even numerical 

'terras, it does nDt-have to be based exclusively on objective 
evidence', (Even when definite facts arid measures are obtainable - 
and they are f ret[uently ' no t obtainable it is still necessary 
to interpret and make judgments about them, thereby compromising 
-their presumed objectivity 1). Objective evidence and measures are 
.desirable supports for evaluation and sVwuld be obtained whenever- 
possible, but they should never become substitutes for judgment. 

All Evaluations by whatever' method , are made by applying / 

Judgment to facts and evidence, A technically sound evaluation 

, should be — ^ • , 

m 

I Based on evidence' that is reasonably complete, accurate 
J and pertinent. 
Valid "\ Evaluate what if intends td evaluate, 

/ Identify' cause and effect. 
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Arrived^at by methods that produce reasonably con- 
Reliable K sistent conclusions when differ/nt, but qualified, 
eyaluators consider the same evidence** 

3* The Purpose of Evaluation ' . ' 



,^ The immediate purpose of evaluating is, usually, to find out 
how well we are accomplishing, what we, set out to accomplish^ 
how well we are achieving the results* we hoped for, but i<^ is 
a jstprile evaluation which stops^there* 



We have a reason for wanting to know how we ^re doing. This 
reason is a desire to improve, to find out at what points 
improvements should be made, and how they should be made. The^ 
ultimate purpose of evaluation is to obtain better information 
on which to make decisions, better information to guide efforts 
to improve. This view has been well set for^^h in Adult Leadership 

.... in the long march- from authoritarian to 

democratic ways of life, evaluation has come ^ . 

to have an educational rather than a judicial \^ ' ^ 

purpose. We may evaluate, not to reward or punish, 

but to help ourselves and others- to set morfe^^ 

adequate goals and- fo discover more effective 

methods of achieving them .... 

If evaluation is to serve as a me§ns of 
improving 'oun activities, we need to go beyond 
the common conception that evaluation is merely 
finding out to-what extent we are achieving the 
results we want. Finding out, for example, that 
a group pf persons learning^ to t^pe has' only 
achieved an average speed of 50 words a minute 
instead of an expected 60 tells us that some- 
thing is wrong. It does not tell us what^is 
wrong, and ' therefore, gi^ves us no clues as to ^ 
haw Co bring performance up to expectations or ' 
^ whether the expectations 'wer'e anr^alisticv > < 

The process of determining training needs is itself a process 
of evaluation. Through factfinding tod .af>praisal, we identify. . 
. problems that' need: to -be.^prevented or ^olved, weaknesses that 
ne^d to be overcome — thing* that ne*ed to be brought "up to ,^ 
standard.," We pian and carry out training 'to do this. Then, 
to find out "how we*are doing," we repeat. the' ^^clfindinc and 
appraisal — short, we evaluate the situation again^ »Thus,» . 
,/we have a complete cycle: 'need determinatioft (resultin^f rom 
^ . 'J 
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evaluat;ionl^^^r9gram planning, program implementation, and 
evaluation " foHowed by^replannlng^, reimplemen'tation, aod 
reevalu^tipn* , * . ' * " 

If w^' accept thi^ -vjiew, we can begin to see evaluation of 
. . training in\ it^f proper perspective. 'We train anployees — . 

^just'^s we maintain reference libraries, a selection and place- 
^ ment -system, or a p^y plan^ — as a manner of good, admitristrative 
practiceT^'i^ause managemeij;t ' has certain needs i^lch experie||ce 
has shown subK.activities can help meet. 

Evaluation *of training, like evaluation of ' thes^^ other activities, 
should be designed not to justify its existence or to prov^ it ^ 
"pays' its way" but, rathef, to enstire that training is used as 
effectively as possible in meeting management's needs. 

4/ Comparison with standards 

*i ' > , 

"Pract^-cally all evaluation involves comparison, whether conscious 
or urtconscious, of facts and evidence with a stemdard of some kind. 
This standard may be implicit or explicit, clear or fuzzy, absolute 
or relative. Traiijiing' standards will necessarily — and not an- i» 
-^'desirably — vary* InAind, in dief initeness and in tangJJbility , 
* depending. on the goals of the * training-. Forla standard, according 
. tp the dictionary as well as common practice, is simply that which 
is "viewed as proper and adequate for a given purpose." 

^ ^ An 'evaluation standard is an operational ^f inition^ of goals, 
' . # stated ±ti terms which^Cprovide a bp^e of ref erence- from which • 

to detennine wKetljea;^ the goals are achieved. A good evaluation, 

standard will be: 




Relevant to the purpose or goals of th^ activity 
Seing evaluated. * 

Acceptable to those importantly concerned — the 
^valuators, 'the evaluatejl, and thje users' of the 
evaluation. / ^ 



* Definite enough to 

has or has not been achieved 




etermiiiation that it 



* - Reasonable and possible of accomplishme: 
We shall talk more about standards- a bit late:*--> 



V 
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Three Prac^cal Questions r 

There are three simple questions tha.t can help keep our 
thinking about training evaluation practical and "on th^ 
beam." -They are: 

« . - 

1. What changes in people or things or situations will 
occur if we acco;nplish our goals? 

i\~ How can we tell whether these changes -ar^ actually * f 
occurring? ^ ' 

3. How can we tell whether they result from training 
^ ' or from something else? 

- r 

Answeri^lt the. first question — what changes will be evide^ice 
of goal attainment? — requires^s to consider what data will 
indicate change. Many different kinds of data m^ay be^^levant,. 
including some, frequently unrecognized and even more rrequervtly 
vnpredicted. (One evaluator reports tTiat while a vertically- 
^tructu^ed supervisory training course apparently produced no 
change in the "top man," it dp appreciably increase the 
tolerance of lower-level supervision for his behavior — a 
result not to be lightly regarded I,) While we can seldom ^ecify 
in. advance all thfe kinds "of change tH^f^ill take place , if we . 
achieve our* goal, we xan and we must specify what ^ome of these 
changes should be — and 9btain data on them. ^ 

Answering the second question — how can we know whether they 
are taking place? — requires us to consider' both" sotffrces and 
methods^of 'obtaining .data. These will be similar, in general, 
' to those already d£;s«ibed" in^Chapter I. That is, fact-finding - 
and opinion-gat^ierin'g* processes of the same general Kind used * 
to define training needs and set training objectives will -«eed 
-to be r^feated, but trln^-pointed to the specific kinds fef evidence 
expectedS^ 25 » ^ 

Answering the third question are they the result of training? ~ 
^ gets' more complicated. requires us to try to isolate training 
*i[Tr£luences tj>f t might have produced a given change. Use of control 
gfpups or situation^ is the recommended method of doing this. Such 
g^ups 'can and should be .used mor^ frequently than they are, hut 
they may be IjnuracjtLcal or even impossible in some administrative 
settings. In such cases we must 'find other acceptable, ^en though 
^ ilo£, ideal", *met hods and be. prepared to accept^ evidence as distin- 
guished from prgjpf. ' >^ ^ * ' \ 
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Evaluation plans that will provide for getting answers to 
these three questions should be made , when training is being 
planned. If needs are defined and objectives set^jfh the basis 
of careful analysis of programs, operations, and people; 'if 
this analysis is particip-ated in by those importantly concerned; 
ancf ^^f this general process is repeated after^ training, thfe 

Itlng evaluation will be adequate for rao^t administrative 
purposes. * ^ ' ' ^ 

Major Steps / * ^ , ^ 

The major steps that should be taken in evaluation of trainipg 
are outlined below, both to Jielp us see the process whole and 
to provide a general guide for the mor^, detailed discussion 
which follows. 



MAJOR STEPS' IN EVALUATION , 

With full participation of representatives of dll- groups 
importantly conce-med: 

* 1. Develop Evaluation Plan: 
Decide what to evaluate. 
Set evaluation standard^^ based on program goals. 

Descr4,be conditions and/or kinds of change expected ^ 
^ or desired in people, things, or situations. 

If possible, specify extent of change expected. 
Determine wh^t kinds of data will infiicate change.' 
Develop sources and methods for obtaining and treating 
data. 

2. Pretest .Plan: ' 
' Try. out plan on small scale. . * 

Analyze results and 'revise' plan as necessary. 
• Get any formal approval required. 

J ' 3: Collect and Analyze Dataf ^ ^ 

Be thorough and systei^atic. " , 
V ' ' Collect both "f avo^^pible" and "unfavorable'* data — 
, as much and as* representative as practi^cable. 

Try to relate cause and effect, recognizing tfaat many 
_^ * factors' may influence any given "result." > 

t 4. Compare Findings With Standards: 

Cori;^ct for known disfe-ortions and biases. ^ ** 
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If objectives were not- achieved,- determine why 
they are^ not. * . * 
* ' Determine what improvements are needed in training, 
^ \and what changes are i^equired to^prqduce these 
improvements. - ' . 

5. Plan and Take Action , Based on Findings: 

We C£mnot overstress the importance of broad, partici- 
pation in 'evaluation, either- as a fcasis for establishing 
a program or for appraising its effects. X^ere Is no 
better way to remove fear of evaluation; to ensure more 
accurate, acceptable, and meaningful judgments; to gain 
understanding of and cooperation v«tth needed' improvements • 

Deciding What to Evaluate 

Strangely, we are not always clear what should be, evaluated. 

The results of a particular course'f' Imtnediafe or long-range? 

In terms of changed attitudes, 'changed behavior, monetary savings, 

or^what? The trainers' skill? 'The training' process itself?- 

As seen by whom? Th^ overall training program of t^he Department? 

In what terms? 

We can better determine what shpu3,a/be evaluated by asking, "who 
needs to 4cnow what; and why?" This is essentially a management 
decision, and it Vill necessarily vary with' needs, pritDrities, 
interests, and objectives. .1^enerally> however, it ^eems tha^-r 

The supervisor wants, and need^ to kndw, whether the improvements 
desired as a result of training ^re actually madej whether torainitig 
is done efficiently and economically; and whethei( training f^^being^ 
dbue in the areas of great^'s^t neerd. . . '''^ 

Training people want and need to know, in addition, whether anti 
how the training process can be improved. This suggests the 
desirability of evaluating: • . ' ' •* ' 

* Scope and goals of the 'Overall^l^Tttining program.v^o help ^ 
determine the extent to which t^^inijig given is fhat 
which is most needed to further effic^eprt pperailRLcfti ^nd 
objective accomplishment, and What' changgs,^if any. are 
needed in coverage and emphasis* » * 

* Organization and administration of^ training, to Help ^ 
- determine adequacy of provisions for training and >hetl]er 

training operates ef'ticiently and . economically * 

38 
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*' The training itself 

To help determine the extent to which trainees understand 
and accept wl^^^^^ being taught, ^nd how the training^ 
process can b\ imlSSQyed. 

"* Results of training 

To help detenD|.ne the exteqt to vhich traijie^ learn and^apply 
what W0S taught; the extent tjS» which changes desired,* as a re- 
• suit of training, . actually occur and- how improvements can be 
ma^e. 

■Evaluation of training results^-- the point of most tangible 
payoff — is of particular concern to line management, especially 
immediate supervisors; it will usually be made jointly by these 
supervisors, trainees, and training staff 1- 

How-to-do-it suggestions specific to each of these types of 
evaluation begin on Page 46, ^ ' ^^^^^S._ 

A good overall training evaluation system will: 

* be technircally sound, as described on Page 



* operate 



continuousl)?^ and systematically. 



* 'employ vfaribus techniqu^es, as appropriate to the situation*. • 

* be acceptable to .the Department. 

be administratively practical. 
• « 

^ch a system cannot, o& course, be developed overnight* 
Evaluation should not be delayed until one is developed. The 
imri)ortant thing is to get started — wherever and however your 
own situation permits — *and then improve as you go along. ^ 

Setting Standard s •/ ' 
• . . ^ ^ \ 

Having dfcide4 what is to be evaluated, we must establish our 
evaluation standard. What kind of standard shall we use? - The 
definition on Page 34 provides two imporV§jvt cluefe: 

1. The standard must be something that is viewed as proper 
and adequate. It^must be 'accepted "^^^generally considered 
a's proper and adequate. It should bfe thus accepted not 
only by the -evaluators but also, by thosg |or'whom the 
evaluation ^is 'made. ' 

2. The standard must be proper and adequate for its partic- 
ular purpose. It must be appropriate and relevant to the 
goal, and it need only' be as precise as /required by that 
goal. . . ' ; 

• 39 ^ 
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We^said earlier ^that^ Is the i^ltiinate_purposfe (goal) of - 
tralnlfig. to further ef fliciettt opeijration and obj^tive' 
. accoaplis|pent-> ,and* Aere Is much talk a^oxiy'the need to 
evaluate training in *t&B8 of "ultimate , "^i^h ex thaji proximal, 
criteria." ' . X. , # 



The trouble is that the ultimate purpose of training much 
too "ultimate" to be of practical .help to the training plabner, 
instructor, or evaiuator. Training is only one of^lhamy factors 
Importantly influencing efficient operation' and objective . 
accomplisKment , and it is not reasonable to attritybe^ success, or 
lack of success, in achieving that goal to training alone. The 
ultimate goal is also too general for practicaf usefulness — 
unless we are willing to accept _ equally general^ evaluations, 

"Efficient operation and objective accomplishment" is seldom, 
therefore, a suitable criterion of training succes^^ have ■ 
to work with something less remote, something mote specific, 
something which a^iftits us to relate cause and effect a little • 
more accurately — something, in short, about which we can more 
practically make a judgment. 

This »$omething, expressed ^it op^erational tferms, becomes our 
training evaluation standard. It may, a^ already suggested, 
concern the structure, staffing, and facilities for training, 
or the .scope and emphasis of the training program. It may 
concern .training as a process, or the results of training. 
It may be expressed in terms of changes in trainees or in terms 
of the extent to which these changes improve the situation 
training was designed to help improve. 

At whatever level we decide to evaluate, wje s^et standards by 
translating goals or objectives into descriptions af conditions, 
or kinds and amounts of change, that will be consideredj acceptable 
in th^ particular situation we are dealing with. * V 

Naturally, the ppecif icity and precision with which this can 
be* done will -vary greatly. The. standard may be very precise, 
^ or itrmay be that any observable — or even felt — 'progress 
would be considered acceptable. 

Ideally, we woul((^ translate objectives into definite, measurable' 
texm^y .e.g., numbers, amounts, time degree, quality, etc., to be 
achieved. To determine progress in that ideal case, we would 
simply measure and compare the numbei^, amounts, time, degree, 
or quality actually produced or achieved with that set in advance 
as our standard. • - ^ 
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However, we ^[arely have this ideal situation. • It is often 
impossible tpNtranslate objectives into specific, measurah^ 
terinaL» little is known about work TDeasu;reiDent and 

productivity; too little about education and training; ^toO 
little about evaluation.) We may even finS ourselves unable 
to 'specify in advance all the kinds of change that will indicate 
goal achievement, TDuch less' the precise amount that will be con- 
sidered acceptable. 

In such cases, it is meaningless to try to set standards in 
^d^finite'f measurable terms, ,even for the sake 'of making a more, 
convincing .or a more "scientific" evaluation. By so doing, we 
would allow evaluation to become aq end in itself, rather 'than 
a meana-af obtaining better information on which to base judgments, 
and the result#vov^ld t>e worthless for administrative purposes. 

Fortunately, neither management nor trainees nor their superiors 
demand or expect precision in such cas|s. Fortunately, training 
-staffs do not require precision to find out how training can be 
improved, ^nder such -circumstahces and until better methods 
are available, we can accept ~ for administrative if not for 
research ^purposes ~ less specific. and concrete standards. In 
th^liase of human relations training for supervisors, for examp-le, 
can say that our objectives will^e achieved if — 



we 



* >Jost employees of trained supervfsors express reasonable 

* satisfaction wifh the supervision they receive. 

* Most trained supervisors believe that the training helped 
them better understand and deal , with their employees, 

* Superiors of most trained supervisors believe that the 
train'ing helped improve supervisor-employee relationships. 

We c^n usually improve this kind of standard, however, by 
identifying in advance \he specific aspects of the supervisor- 
employee relationship which training should help improve. 

For axample, 

^Supervisors*, willingness and^ability to listen j:o employees. 

Supervisors' attitudes and actions in explaining the whys of 
office Changes to employees in advance of the change. 

iiployees* confidence that supervisoi's will give fair consideration 
tcl ^eas and suggestians. ' * 
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Their confidence that supervisors WLll be just ^nd impartial 

in recommending personnel actions and in maintaining discipline. 

The freedom supervisors all(5w employees in plaraiing and making 
decisions about their own work, wlth±n a prescribed framework. 

Supervisors' willingness to delegate and their acceptance, of 
'the fact that with delegation there will inevitably be some ^ v 
errors that might not otherwise have been made. 

Employees' feeling that their supervisors will "back them up." 

Standards, in whatever terms and with whatever degree of 
specificity expressed, are likely to re^Sresent: , 

* The exT)ectations or requirements of management, on the ' 
logical assumption that training should meet management's 
needs. 

* The expectations or requirements of trainees, on the 
logical assumption that unless training also meets what 
trainees feel to be their needs, it is not likely to be 
applied effectively by them in meeting management's needs. 

* The recommendations or requirements of experts or 
authorities, on the logical assumption that organ^ations, 
programs, 'or activities whlcJi meet recogijized requirements 
of good practice are generally more likely to succeed than 
tho^e which do not. / ^ 

* 'Some combination of these. 1 

Developing Soujrces and Methods d)f .Treating Data 

Having stated as specifically as possible that changes are 
expected to- result from training, we are ready to determine 
what kinds of data will indicate change, how and where to 
obtain this data, and how to treat it wh^ it has been obtained. 

Going back to human-relati,ons training for supervisors, for 
example, we could decide that we would accept any or all of 
these kinds of data:' 

^ * General impressions of superiors, fellow supervisors, 
employees, staff officials. 



* Reports from any of these sources on actual incidents in- 
volving, or actions taken by, the supervisors. 



* Superiors.* ratings of supervisors* performance. 

* Observed behavior of Che supervisors on the job.* 

* Scores on supervisory judgment tests, 
nteei^ 

* Records onjsuggestions [in the supervisors' work groups. 
I turnover^ 

;r ievances 

*• 

* Results of -attitude surveys among the supervisors* * 
employees, etc. 

As already suggested, we can gather this kind of information 
flrom the same sources and in mtich the same ifeys described iti 
the section on identifying training needs. The evidence sought, 
however, must now be pinpointed to the specific* training objectives 
and standards we established in advance. 

\ 

The data gathered should be as complete as practical considera- 
tions permit, and it must include all reasonably available 
indipators of both success and lack of success. 

Onae^the data has been gathered, the extent to which training 
objectives have b«en achieved can be judged^by ccnnparing the 
finding's with the previous.ly established standards. 



In addition: ' ^ ' A 



* To obtain more- accurate and precise estimates of the amount J "before 
of change made, we can compare, the same kinds of data for "\ and 
trainees before and after training. after" 



^'matched 



* To help determine whether any changes foufid are due to 
• training or to something else, we can compare the same '^controls" 
kinds of data for trained groups and reasonably comparable 
untrained groups in the s^me envirorLaent . 



* to" help determine relative effectiveness of various training r 

methods, devices, timing, instructors, etc., we can compare./" successive 
the data for successive groups of trainees exposed to the | groups" 
same training content presented' in different ways* - ^ 



f 

10. Pretesting the Plan 



T" 



After the evaluation plan has been developed, it should be 
pretested, approved, and pat into effect. Since most of th^ 
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operations involved in this process have already been discussed 
elsewhete in this pamphlet, they will be dealt with only Very' 
- briefly here. 

The Evaluation plan decided on should be tried out first on a. 
* - small scale, to make sure that it is practical, that it obtains 
the kinds of -"aata required, and that it can b^ interpreted in 
meaningful' terms. - , ^ * 

interview orjrquestionnaire forms, for example, should be used 
on a trial basis with several representative people, and the 
evaluatbr should check carefully to see that the questions are 
clear, easily understood, and productive of the kinds of facts 
and opinions about which information is needed. He-shbuld also 
check to see how the responses can be reported and what kind of 
code, if any, may be required to clarify anJ^ummafize them. 

After necessary revisions in the ^lan are^made, any^formal 
approvals required for its use should be ol?tained, 

11. Collecting and Analyzing Data . . 

The data collected must, of coujse, be relevant to the objec^:ives 
of training and it must, as wejha've already emphasized, include , 
data on all of the changes whTch training was intended to produce. 
It should be as comprehensive as practi^ial, and it should be drawn 
from sourcBs that are representative. It shpuld be systematically 
recorded. It must include all reported or discovered evidence, 
both favorable and unfavorable. It should also include any 
' available clues that will help relate caJses and effects. 

Do not overl^k the information available in management reports 
and records but^use it with caution, remembering th^t it 
usually shows^ results without indicating ^uses. . 

Summary and cla*ssif ication of the data should-T^e very carefully, 
done.- If a coding system is used, different people should coie 
an identical sample 'o^ the data independently,- then compare. 
results and resolve an^ discrepancies found. Thereafter, spot 
checking of the coding will' usually suffice to insure a reasonable 
degre% of consistency. 

12. Comparing Findings with Expectations 

When the d^ta ha^fe been collected and summarized in a reportable 
form, the findirf's can be appraised. As we have been emphasizing 
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throughout this bookle,t, there shoultJ be widespread and 
■ representative par ticipatridn in this appraisal. It may be 
desirable simply to report the unapptaised facts , .possibly 
with some tentative suggestions about relationships and possible* 
implications of these facts", to groups of those people most 
importantly concferned, and let them mak^' the appraisal' by com- 
paring the fihlSings with the standards that had been set.. This 
is the feedback processimentioned in Analysis of Data on needs 
(Page 27). • 

All of the observations made in th^t section are equally 
applicable to analysis of evaluation data, for as already 
s**ggested, need determination and evaluation are two sides 
of the same coin. Those observations will not be repeated 
here, but it is suggested that they be reviewed as a basis ' 
for: 

Planning and Taking Actio^ on Findings 



Analysis and a^Jpraisal of "evaluation findings in the manner we 
have been discussing not only indicates how well training 
objectives are achieved but also what changes are needed to 
make -efraioing serve management needs more effectively. 



Lons 



The pages which follow contain j::harts, samples, and descriptic___ 
to help stimulate your thinking about ways of evaluating training 
and to illustrate how the various plans and methods we have dis- 
cussed can be applied to evaluation of —y 

k / 

^ Scope and goals of the overall program. 



* Organization and administration of training, 

* The training process , i tself , 

* The results of tfaining, ' / 
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HOW-TO-DO-IT SUGGESTIONS AN»-^AMPLES 
TO EVALUATE SCOPE ^U) GOALS OF OVERALL TRAINING PRPGRAM 

Look for eviden ce on — ^"^"^^ 
^ * definite plan of action for the training of employees 

* def i-nite provisions for determining training needs and 
assessing progress 

* needs met, problems solved or lessened • 

* needs not met, problems not solved or lessened 

* reasons for and consequences of training not given 

* attention to future as well as current needs and problems 

* efforts to encourage -employee self -development 

* etc, i 

«k 

As revealed by^ — 

* review of management policies and^directives affecting 
employe^ training ^- ^ 

reports of surveys, studies, inspections by\inanagement 
staffs, personnel inspections^ 

* analysis of management data 

* check on plans for future expansion, contraction,, shifts 
in program emphasis; significant changes in organisation, 
functions, methods 

* analysis of ttaining results and their impact on tlie 
organization 

* etc. 

-_^jid compare findings — ' " 

* with standards representing the judgment of 
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experf s 
--.management 

— ^6pervi&ors * 

— employees 

ad to what the training .program should be 



V 



in order to obtain better information on which to base such, 
judgments as : - 

-# 

*- Is the training that is given actually ne'eded? 

* Is it the training that is most needed? - 

* Does it attfempt to m^et future as well as present needfe? 

* Are significant needs not being met? Why? What should be 
done about it? 



* What changes, if any, should be made in thr'^ope and goals 
bf the overall program? 
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Order or regulation 



Personnel records 



Inspection reports 



Other management data 



Check ft^irp plang 



IK 



> Employ eH^idgment^ 



Supervisory judgment 



Executive judgment 



Not needed 



Not given 



Excellent 



Satisfactory 



Weak 



Observation 



Management directives 



Personnel records 



Inspection report s^ 



Other management data 



Check future plans 



Employee judgment 



Supervisory judgment 



Executive judgment 



Top 



High 



Moderate 



Low 



u 




><l (>< X X X X 
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TO gVALUA^E ORGAIWZATION 'AND ^IINJSTRATION OF TRAIJJING, 



/ LOOK FO^-EV^MNCE 01} ~ ' ' ' ^ ' ' L 

9 * * . '' ' "/ 

*^-' general attitude of mahf^enlebtf* (all' levels) and^ployees 
. ^ ^ tqpiyard training - * 

* del.ineat.ioii of linq^.and staff * responsibility for training 

' understanding and acx:eptance, in 'practice, or these . ' 

responsibilities * * / . w ,^ 

' • <^ ^ 

^ . *^ provisions for ensuring thdt obvious training needs 

(e.g^ orient^ti'op, "preparation, for supervision,- instruction 
" ' on new work) are met / 4^ • 



id evaluating 



hoy system for deterjilning trai^ng-'ni 
tr^ning actually operates^ 

* ktftds 9t training given .anH'aot given, i^n relation to 
[\ . needs, qlimate and resources 



nM^s aiic 



.^ training competence offline official^ \ \ 

* §dequacy^ Cnuraber, type, ' quality) -of training staff 

* adequacy of sfa^e," ^ equipment, oOier training facilities^ 



AS REVEi^ED BY ~ 



* observation atid- inspection of training 
^ * organization aMructure'p^ assignment' of functions' 



'^Vta^^^ of ^ployees^,, sijRervlsors , top maifagtoent;^ 
Ijispectidn and audjt reports » 
' f ol3row-uf) Tre{)^rjt& on persofiilel processes 

. * * r^^^ ,of backgrSund an(? performanc^of training staff 
- . % ^ ^ *^ chi«J$^^ Jindncial provisions for training^ 

* th^ckor management policies and Instructions ^ 
" ' * ^tc, / ^ " ' 



49 ' 

4 55 



C(»iPi^RE FINDINGS ~ " * ' ' 

* ^ with standards representing th.e judgment of - 

experts 
•supervisors 
top raanagei^i^nt 




in order to obtain better information on which^ to .fase such 
judgments as : ^ 

* Is the training' function clearly 'assigned , recogni-zed, 
and accepted: in'the^ organization? 

. 

* Are* line and staff ^responsibilities properly delineated, 
^U^i^^eqiiat'e provision for coordination; 



^ % ' * Are there reasonably adequate and appropriate space, 

y » . ^A^uipment, materials and. facilities for training? 

. * ^* Is^he training staff ad^uate? ' 

/ 

* Does training actually 'get done as planned? 

' ^ * What changes, if any, n^d to be made in organization 
an^ administration of training? 
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EVALUATION^ OF ORGANIZATION AND ADMINISTRATION ^ 

* - ' • s , 

PF TRAINING , . 



^ Item t;o b^^ evaluated (add others 

appropriate to specific situation 



7" 



1. 



^2. 



5\ 



9. 



10* 



11, 



Is there a clear^ statement of 
rainin^policy? ^, . . 

Have resources necessary to 
implement it been provided? 
% 

Is line responsibility for 
training recognized? 

Is enough staff assistance on 
training provided? 

Is delineation of line and staff 
responsibibil^ies -understood and 
accepted? * * * 

How effectively are line an^ 
^taff training efforts 
coordinated? 0 

■•^^ / ^ 

_,What i§ the. leval of competence" 
of the -training staff? 

What is the level o-f training 
competen<;e of tha line?* 

■ ' f 

' What is the general , att itlide 
' of management (all levels) 
toward training? • - * 

^-What is the general at;,flKide of 
ei^ploy^e^toward it? 

Hqw well are crientatt<f?rand 

induction accomifTis^d in 

actual practice? ' • v 



> 
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Kind of. data 
used as basis 
for judgment 
in evaluating 



Remarks and^ 
observations 
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^ 12. How effectively are such • 

resources as staff conferences, 
job rotation, guided experience 
used in meeting training needs? 

13. How adequately does the plan 
for determining training needs 
operate? 

14. How clear are the goals af the 
training that is given? 

15. How carefully are plans for 
training made? 
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V, 

• TO EVALUATE THE TRAINING pjDCESS 

LOOR FOR EVIDENCE ON ~ ^ ' . 

*' clarity of training goals 

* -relationship of training to trainees' need^, interest, capacity^ 

* ' « 

V * relevance of training to the problem to be solved 

* 'Comprehensiveness of content in relation to objec4:ives 

* variety and appropriateness of training ^methods* 

* interest to prospective trainees ^ ^ 

* use of accepted teaching-learning theory 

, * adequacy of physical accoimnodat^ons - . ' ^' 

* provisions for follow-up or check on application of t;raining 
•in each trainj^ng course or program 

' AS REVEALED BY — ' - \ ,\ - • ' ' 

* observation of trai^idjg groups < 



1. 



EMC 



/ 



* statements and recomm en^t ions o£ trainees and tfTelr supervisors 

* inquiries and reactions bf potential trainees 

* analysis of traitees' backgrounds - , ^ 
analysis of training goals, content, methods 

* etc. S • • . • 



AND gOMPARE FINDINGS — 

*\ with standards representing the judgment of 

) - . ■. ' • 

experts 



experts 
^ttalnees^ 
supervisors 



' f 
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^or successive groups of trainees give the ^same general 
training, content in ordeq: to obtain better information 
on which to base such^ judgments ' 

- Hr" ' ' ' > ' " 

* Is the content relevant to the problem training ^ ^ 

is intended to tesolve? 

* Is it comprehensive enough? 

* * Does it require active, position participation^ 
by trainees? • " • ' ^ 

* Does it, provide experience and practice as- well as 

ifif ormation? 

* ■* 
To what extent does it tie in with trainees* personal 
needs and interests? 

* What changes, if any, should be made to improve the 
erf ectiveness of the training process? • - 



V 

\ 

• \ -v. 



• K 
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TRAINEES' EVALUATION OF PROCTAM ' ^ 

(To evaluate trainee reaction to a student7trainee program) 

1. How did you become acquainted with the student-trainee program? 

2. What was the nature of your summer assignment? 

3. (a) How interesting 'was your assignment? 

Very Much Quite a bit Soitewhat ^ ^ Very little 

Cb) In wtiat'ways did the assignment-interest you? 
CcX^In what ways was it ihiinteres ting? 
'4. (a) To what extent did the work i^ilize your professional knowledge? 

To the limit ^ Quite a bit Some _^ *Not at all 



(b) How did the work utilize your professional knowledge ^ if at allf 
$. (a) Was" the experience of value'to your professional education^ 

Definitely . Probably ^I doubt it ^ No J ^ ^ 

/b) How was it of value, if it was? 

i P 

6. How familiar did you become with^other programs and responsibilities 
• of the agenqy? ^ ; 

/^ry famili^ar Fairly familiar A little j Not at all _ 

7. Irf what ways, if any, did the work increase your interest in a career 
in the agency? * • 

8. Making allowance for the temporary nature of your assignment, mark 
the point on the following scale which bfest characterizes your 
feelings abou^ the* summer's experience: 

/ . ' 

1 ' 2 3 4 - 5 '6 7_ 

Little 7^ ^ ^ " \ Highly 

Value _ , ' Valuable 

9. How can the 'program be improved? 

10. Axe you interested in further employment with this agency after you 
complete your professional education? 

55 ■ • . 
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GUIDE POR OBSEKVAUON OF OFF- THE- JOB TRYING 
(Conference or discussion typjl 




\ 



1. 



3. 



- 5. 

6. 
7. 



10. 



11. 



ERIC 



Was traindng based on a survey of trainee 
problei^^and needs? — , 



60 

c 
c 



Dii trainees know subject of session in 
advance and come prepared to preserrt 
problems and suggestions? 



Was objective cle^ to both instructor and 
trainee? 



4. ^ 



Was material organized to provide step-by- 
step progtess in ^thinking?" -— 



Did session result in car-efully thought out 
solutions to prc5blems considered? 



Did trainees contribute to grmip thinking? — 

Was instructor successful in recognizing 
key points and in getting group to recog-^ 
nize them? 



Was discussion concrete and practical and 
did it avoid straying into abstra<:t? : 



Did instructor establish friendly give-and- 
take relationship within group? — i 



Was subject adhered to and -digressions , - 
avoided, even those that were interesting 
but irrelevant to the subject? 



Did session move forward without waste of 
time? 
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GUIDE FOR OBSERVATION OP OFF-THE-JOB TRAINING 
(Conference or discussion type) 



\ 

/ 

12. Was training effective in getting at real 
causes of train^s' difficulties? 

13. ' Did instructor help trainees to formulate 

general principles for use 'in solving 
problems similar to those discussed? 

14. Did instructor express his own ideas 
clearly to group? : 

15. • Did instructor draw ^pon previous experi- 

ence of trainees to help solve problems? 

16. Was apiJropriate reference made to related 
previous training? 

J7. ^tc, 
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EVALUATION 07 ORl€?4TATI0N PROGRAM 

Your looking-back-on-the-program observations ^^TTT be of real help 
to the Course Director in planning future programs and in getting 
them presented as effectively as possible. Will you, therefore, 
answer the following questicm^ fairly and frankly? You need not 

sign your name. " ^ 

~~ ^ » 

1. Is it your overall reaction that the ^rcgrara has been: 

^No Good Mediocre ^Good ^Very Good ^ExcelleA 

2. Which sessions did you consider best? 



3. In what way(s) do you feel the program as a whole will be of 
value to you? 



4. (a> In what way'(s) was the program wealcest? < 

(b) What- specif ic practical suggestions can you 6ffer to^help 
overcome these weaknesses? 



5; V&iat do you especially like about this agency? 
6. What do you especially dislike about it? 



7. (a) *Ha9e any of your opinions or attitudae been changed in the 

course of this' program? ^Yes No 

(b) If so,' which and in what way? 



8. Have yoi> anyjdditional ideasj suggestions, or comments about 
the prograi^^pf so, please let us have them here: 



anv^^d 
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COURSE DIRECTOR'S EVALUATION OF ORIENTATION 

What is your rating of the program for each of the following items? 
Circle the appropriate number. 



Very 
low 



Low 



.Aver- 
age 



1. Physical arra^ngement and comfort- 12 3 

2. Group orientation ' 1 • 2 ' 3 

3. Group Atmosphere ~- l 2^3 

4. Interest and motivation 12 3 

5. Participation 1 ' ^2 3 

6. Productiveness 1 2 3 

7. Choice of methods— ' 1*2 3 

8. Communication 12 3 



High 



4 
4 
4 
4- 
4 
4 
4 
4 



'Very 
high 



5 
5 
5 
5 
5 
5 
5 
5 



COMMENTS : 

What to consider under the items 

V 



listed ; 



:essary interruptions avoided- or 



1. Physical arrangeipent and comfort: ^ 

a. Did the. seating arrangement contribute to informal^-ty and to 
groups participation in ,the discussion? 

b. Could members see andJPear each other clearly? Were dis- 
tracting noises aTrd^^Tinnec es 
eliminated? ^ 

. c. Were the chairs comfortable? 

d. Were the -ventj^la tion , heating, and lighting arranged for 
maximum comfort? - ■ ^ 

^ e. Were the 'activities and rest periods well timed for cpmfort,? 

2. *j|^roup orientation: 

a. Did group members understand the purpose ^for which they 
were meeting? Do they know the meafning of "orientation"? 

b. Did group mjsmbers understand clearly what they were to do 
and what 'they could expect from the leader? 

3. Grouf) atmosphere: 

a^ Did everyone feel free to ask questions, express his ideas, 
agrJb or disagree? . * . : 

b. Was the situation made corffortable for shy peojple to 
speak up? 

c. Were gtoupmembers given a feeling of friendly acceptance 
or was the atmosphere cool, indiffemnt, or hostile? 

d. Did the , procedure tend to be formal or informal? 
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4. Interest and motivation: 

a. How Interested were group members? . . 

b. Did the discussion carry into the breaks^and continue 
after meetings? 

c» Was there evidence of any serious thought being given 

to the 'programs and problems discussed? 
d. Did interest and understanding remain relatively high, 

or was it low much of the time? 

5. Participation: 

\» Werfe all members of the group involved in what was going on? 
b» Did all members make some contribution? 

Did ^ the leader and the more active members make it easy 
for the less vocal members to take part? 

d. What-was the quality of the pa-rticipation? Were group 
members' really digging into the topic? 

e. Did the leaders get the suggestions, ideas, comments of 
the group on questions which came from the group? 

6. Productiveness: 

a. To what ^ext^nt did the program add to the knowledge, or 
favorably affect the attitudes, of its members? 

b. Did members get something which they feel will be useful? 
c* Did they seem to feel that the objectives, programs, and 

activities of the agency are important? 
d. Did they appear to a'ppreciate how their own activities 
contribute • to agency programs and objectives? 



7. Choice of methods: 
a 



Were the methods used the best that might have been' chosen? 



b. Would other methods have saved tirade, made^for greater interest," 
more participation produced greater understanding? 

c. Were methods varied to fit particular purposes and situations, 
or was the same method used for everything? 

d. How well were the methods adapted to the experience and 
competence of the gi:oup? ^ ^ 

8» Communication: 

a»^-Did speakers and group members speak clearly, and 16udly 

enough so everyone could hear? 
b* Were ideas expressed in words wHfch everyone could understand? 
c! Were speakers and group members trying to communicate ideas, 
or were they trying 'to impress others with their knowledge? 
* ,d- Were the examples c\iosen to illustrate points the kind with 
which most group members were familiar? 
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FACTORS TO CONSIDER IN INSTRUCTOR APPRAISAL 



ERIC 



TOE GOOD INSTRUCTOR 
ft * ' 

_ , 

1. States title and objectives of 

the session 

2. Motivates students . . . 

3. Explains new words and terms 

4. Uses practical, everyday examples 

to clarify points in the lesson 

5. Relates the ins truction jfeo other 
class or shop work.T.VT^ ^ 

6. Uses instructional aids effectively.. 

7. Stimulates student participation 

8. Checks frequently for understanding 

' of things taught 

9. Uses^ good questioning techniques 

10. Keeps, discussions on the sobj ec t . . . 

11. Sees tha^t discussions reach ^ 
satisfactory conclusion 

12^ Stresses safety precautions 

13. Varies methods to provide for most 
efficTient presentation....^ 

14. Summarizes the session.., 

15. Makes definite assignments (tells 
what, how, when, why) ^. 

16. Provides r^ef erences . . . . , 

17. Gives evidence that he knows the 
subj ec t 

18. Maintains interest of the class....... 
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AVERAGE 



HIGH 



,3 
3 
3 

3 
3 
3 

3 
3 

3 
3 



4t 



3 
3 



4 

4 
4 



4 

4 
4 

4 
4 
4 

4 

4' 

4 
4 



4'. 



\ 

4^^ 



5 
5 
5 

5 
5 
5 

5 
5 

5 
5 

5 
5 



19. Uses language appropriate to the 
" group 



20. Maintains good poise and bearing. 

21. Has pleasant voice and easily ' 

" understood diction '.■ 



2 



3 , 



4«> 

4 



5^ 

-5 



/ 
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CHECK LIST FOR EVAlUATIfirN 07 TRAINING * 



ITEM 



How appropriate is the training to tjie 

* , objective it is intended to ach±>eve?.. 
Hqw clear is Ai^ objective, both to ' 

trainees and to" those responsible 

for the' training? . 

How apparent to trainees is the W 

* . portance of what is"being taught? 

How Clos^ely related is it to trainees* 

^ .'needs and Interests as they see 

those needs and interests'?^.... . . ' 

Hov clear .is"^ its r elatioiiship to their 

* own jobs and responsibilities? ....>... j 
How well is yhat is going on related to • 

what trainees already' know, •and * 

understatii? 

How appropriate is the method (s) to the 

* object!^ and fhe content of training'? 

How well is tralnees^' interest cau^t 

and held?. . ^ . . . . . 

»^ _ ......... 

To what .extent dt trainees have an 

oppotturiity to participate activ'^ely 
and- perso'ftally^n the ^training? 

,How adequate^ is the disc«esion leader's 
kn6wiedgl»;9f .his subject?;.* 

Hoy able is "he fin clarj^fying " and getting 
und-er standing of difficult prpblems 
and ideas?,. 

How effectively is the time that is 

available for training used,?...^ 

Ho\4 well balanced are the tffeoretical and 
J the practical phases 'of the tz^aining?. 

IJpw/ Smooth are the administrative mechanics 
/ 9f. the program? \ 

How well can trainees see whatever is 
. ' being shown? ^ 

How wel]^ q^n they^ hear what i^ said--- 

both by guest spe'akers and by other ^ 
trainees? 1 4 . ... 

How effectively are trainee^' suggestions 
for improving t>ie tralnj.ng obtained 
and used? . . . .jj. 



l^OT 

APPLICABLE 



LOW 



HIGHi% 



2 .3 



5 
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How adequate are .provIsionB-^f or letting^ . 
trainees know how they are do^.ng at 

' various stages of training? 

To what extent is opportunity provided 

trainees to practice either with 

the group, on» the job, or otherwise — 

• the things being taught? • 

How realistic is this practice? 

What'^effort has been made to provide a 
climate whicj^v>will encourage trainees 
to appl^y the training? ' 
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TO EVALUATE RESULTS* OF-TRAINING . 
LOOK TOR EVIDENCE ON— ' • ^ ' ' ' 

* knowledge of what was taught^ 

,* interest in ^ understanding^Ja^ceptance ^ wha^ wa^__t aught 

* on*-job use of what was taught and reasons i^ not used 

* effect^of training on such spe9i£ics as— . ^ 
— agency's operating problems 

— quality and quantity of work ' % 
—public or custOTner^tisfaction with prCKiu,ct or servic 
—^p'ef^li'or-enipT^b^e^and/oj::.^ group relationships 
—aaployee will, to work, pride in work, morale 
—agencyjs ability to attract and hold employees qf the 

type and caliber .desired 
—agencyjs ability ^to mee^ promotion, expansion, change- 
oyer staffing needs 



AS REVEALED BY-- 

* test scotes 

* perf ormafice' ratings ' ' 

- - . * 

*^^naly8is of persormel records and reports 

** inspection and audi^ reports" and recommendations 
% . ' 

* analysis of producAon, cost, and CtKejt^nfg'eraen t d-ata 
/ ^ 

* . statements^' of trainees ' • 

* stataments of supervisors', staff officials, ^ecutives. 

* etc. 

. ^ ^ ^ 

AND COMPAKE iJNJDINGS-- 7 ~ -ir; ^ 



* ^with standards rep:^esentiTig >he .iudgment of, 

— trainees ~ . 

. — supervisors ^ v 

..-•management * . 

* before and after training - ' 



^ ' * for Jtrained^ versus untrained groups . 

* with definite Tneasores, known pr desired 

in order to obtain better information on whicfh to ba^e such 

3\rdgments as: . . . r* ^ 

d iO TW1,n W*' 'SS'^^^f^^"' producing tTirxfesTre 

" change^in employees' knoWledge?_^k ills? attitudes^ 



To^what extent did it resolve the probrem it was^ designed 

< 1 o 



',resolve? . ^ 



* 'If the desired ghaBges did not occur, why not? (Had ^' 
trainees' the background and ^capacity required? Did the- 
work situation" permit and .encourage ^th^ to apply the 
training?) . , ^ - 

* .What ot^^^'r changes, if any, did it produce? Were they 
'good or bad? s ^ ^ 

-What^ changes, if any, should be mad^ to get better 
training results? 



GUIDE FOR EVALUATING INTORMAL 'ON-JOB TTRAINING" 



ASK THE NEW EMPLOYEE:- ' ■ .. .' " 

^.^ 1. What is your job here? Or "'Tell roe something atout 

yy r work." . " _ _ 

2> *9mo helped y yu 1p ,- ^rn t fi i l n j i i iir " I nF^ 7 

What does. your Service do? " ' ' ' ^ ' > " 

4.. Who is your supervisor? ' ^ ; , 

V -5. , Where would you find the Department's personnel policy,' 
appeal pi?oicedure, or information on conduct ^^cted of 
a Department employee*? ' * * . 

6. ^ Do you have a copy of the ' Department ' s employee handbook,? 

7. - Wh^t^as been done" to help you get acquainted?' ' • 
8* What do you like most about'your work? 

ASK THE EXPERIENCEi^-^tEiOYEE: , * . . " 

1. What is your job? ^ ^ * . 

2. What does your'^wrk group do? 

3. Who is your supervisor? ' . ^. . 

4. What does your supervisor do to help you?' / ' 
5*. What Kinds of meetings do you' attend? ^ • V 

What d9 you think of the State Employees' Lif4 Insurance 
, Program? -i • _ 

7. > WoulcJ you do what you are doing diff.erently if you had 
a chance?" 



P 8 



What advantages are there^^o being an employee' in *the 
Highway Department?'/ j \ ^^.-^^ • 

9. Have you ever he;.ped a CTi^loyee get ster.ted' in his 

job? ' 



10. 



How does your iupervisor go about- ratfhg^ your woKk 
4)erf orman(?e?J 



ASK THE SUPERVIS'OR: . - ^ 

» 1. What does' ^our work'gjWDup do? ^ ' . 

2. How f ^r 'afiead do you Jvay^ your work ,p2:anned? 
'3. *What is your policy orf granting leave- to your employees?- - 
'4. How often do you talk with ^your staff asT-a ^toup? ' 

5. Who relieves you or taices 'your, jplace when you are - ' 
ava^^? ' . ^ 6 ' . • y 

6. 'How. do you ,detide fl^w^well- or ^how much work' an employee 

should do?- , ^ ^ * . . ^ 

^ 7.* Do you.tiave performance standard^ for all employees you- / 
supervise? -In Ktitfri^? • .Wherv^aftd how do y6u disjcuss 
them. with ^our entplpyees? * . ' "^s^-"^*'' ?^ ' \ • '/ 

8. What is /our policy ott handjy.ng a complaint from ajj 
. ^ - employee? " - - / ^ \ . 
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APPRAISAL 0? END RESULTS 



Ttfinlng Objectives 



De^r^ase In break-in 
tl»c of new enployee. 



2. 



3. 



4 




Increase in produc- 
tion of 'an employee ' 
or group of enploycea. 



Ellainaci.Oti of* bottle- 
neclw.^ \ 



Cunca^lment of 
operational errors. 



Information Sources and Appraisal Methods 



6. 



If some employees participate in a planned pro- 
' gram of ^training and others do not. have super- 
, visor ilcord date when eacla reached acceptable . 
level of production. * 
b. Determine averarage time required to bring traitfed 
workers and those who receive no organizefl train- 
iogl^to an aeceptable level of pro<*uc tion., 

a. Using prod^btion records, compare pro<iuct ion 
of the employees or groups of employees befcrre 
and after training. • 

b. Compare production of trained aiplpyees with 
thac .of employees or groups that did not 

'receive training. / 

a. .Compare production records before and after 

ttaining . ^ « ' ( *' /* 

b. Deteyiine TVJmb>r of man hour* saved per 
month, 

c. Determine whether {leadlines Srfere met 
j^ooner by eiimiaaiing bottlenecks.^ 

a. Use recordp'of supervisors and ioepectqrs - ^ 
on rejected work> ark salvage. Compare ' 
before and after training/ 

b. Determine average number of j:.ej«cts, errors 
or amount of salvage per worker before and 
after training. 



5. Decrease in amount of 

time equipment Is with-^ 
' drawn frpm production 
fox repairs and^in cost 
of maintenance and ' 
repairs. 



Decrease in 
ac&iden^i". 



Pae maintenance records indicating number ot 
bours per month equipment ifi in shops- for^ * 
^ repairs, and records showing cost of -repair 
^or maintenance!. . 
. Compute amourrt: of time, equipment isJout ot 

service for each worker oi| unit. 
. Compare averse repair Jiae or cost per 
trained worker or unit before and after 
training. \ - 

. Show difference in production. Compare "houf^T 

saved. 

t . lling totnpensation records and records of 
' safety engineer and health units showing 
frequency and severity of ' accidents , com- 

^ paxe safety records for period before and 
after training. Also compare safety 
records of groups trained with those not 
trained to determine whether improvement 
can be traced'- to training. 

b.' Determine cost of accidents ior the two 
(periods compared. 

c( \Show cost of time lost. 
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Introduction of 
ii«w set hods and 
procedures. 



laprovesent in 
)rk habj,ts. 




Increase )iD ■kill. 



S* Cooparc. if possible, timk needed by trained 
and untrained employes Co adapt themselves 
to new procedures. 

b., Coopare tf\e <f f ectivenes^ of the v'* 
new procedures made by the two groups. 

a. Compare supervisor's rating of work habits 
before ^nd after training, based on rating 
gplde for- work habits which supervisors 
cot\slder most Important to performance 
of^he Jo'b. 

a. Conpate supervisor's ratings of skill 
as shown by operations or product pro- 

. duced before and after training- Rate 
skills at least one month after training 
is cooplered to determine retention. 

b. While increased skill is the iisAiediate 
objective, the final results depend 
upon the application of the skills to , 
Improved production. 



10. Improvement in 

« aCClCudes or morale 



11. Improvement in 
judgiBent 



12*_ Decrease In reassign- ''^ 
Bents or releases- neoefe- 
sary because the worker 
f does not meet require- 
ments fjfft production * 
qualit^* and quantity.* 




Compare before and* after training the overt 
evidences of attituile or aorale which indl-^ 
cat^d the need for training, for example, 
high rate of absenteeism or discipfinary 
actions required. 

Compare with similar group not trained. 



.J 



Use to measure the result^ the same 
criteria which indicated the need for 
the training; for example, the number 
,of appeals from decisions. 



f'^gifJ^ CPO record^ of r^assignaents amt 
f^eljc&ses and supervisor's statej^nt of 
^cteuse of^ each action, find out the number 
_ necessary because worker did not meet re- 

^^'uirements' for production quality and quantity. 
Eliminate all cases ^for which training could 
not be expected to solve the probloa^ 



b. Compare number and percentage of those who 
received training with those, who did not, or 
c<xfpare turnover rate for this cause before 
and after training. * 
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EVAhUATION OF TRAINING 



Ask for samples and concrete examples where appropriate. Check: 

1 — If situation revealed .is inadequate; je.g.- no plan exists, 

nothing is being done, employee doesn't know or understand. 

2 — If situation revealed is satisfactory; e.g., -there is some 

plan, somethirTg is being done, imployee knows and understands. 

3 — If situation revealed is highly satisfactory; e.g., there 

, is a good plan, job is being done thoroughly and well. 

4 — If question is not applicable.' - 

t 



Item 



ORIENTATION 
Ask the supervise];' : 

^ ^at plan does .the office have for 

.orienting new employees? , 

Who does this orienting? 

What mateiilals, assistance, and 
guidance are giveh^ thpse who do 

the orienting^? , 

What fallowup' is made to ensure that 

the job is actually .done'' ... 

How is re-orientation handled when 
experienced employees transfer 

or mission changes?...} 

What changes, if any, should be made 

in 6rtent-ation practices? 

Ask a recent appointee : - . 

How did you, learn your way cEround 
wl^ln you first C3m« to work 

here? 

Wha^did other employe^ do to help>. . 
What did your supervisor do to h4lp' 

you? .1 ' ' 

What; written materials were given youf 
: How worthwhile do you consider the job 

( of this agency? ... ^ . *. .* 

^^How daes the work ol your office help. 

• ^- get that job done? 

, ^s this a good outfit to work for?.... 

^"^^y?. V \ 

Sho\ild afjijything 'be done differently ' * 
' -In orienting new employees? If so, 
what?'. ^ . ; . . . : , / 



Rating 

11 ihu 



Act ion 
indicated 
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TRAINING FOR CURRENT ASSlG^ENTS 



Ask the supervisor ; 

What do your employees do as regular' 

work? f 

What do they have to know in order 

\ to do these things well? * 

How do you go about seeing that they 

know and can do these things? 

How are the unusual or infrequent 

tasks taken care of? 

How dp you go about improving your 

employees' performance? 

How effective do you consider these 

measures? 

How do you think employees feel about 

them? 

What resources and help from others 

do you use? 

What changes, if any, should be made 

to improve this training? 

Ask an experienced employee : 

What is your job here? 

Why is it done? 

What do you have to know to do it well? 

How did you learn these things? 

What information and help do you get . 

when work methods change or new 

assignments come up? ' 

How often do you discuss work and work 

plans with your supervisor, either 

individually or with other employees? 
Do you think your supervisor is 

satisfied with your performance? 

Why 'do you think this? 

How do you know what improvements 
' need to be made in your performance 

on this job? 

What changes, if any, would you suggest 

to improve the ^way employees learn 

to work here? 

DEVELOPMEf^T OF POTENTIAL FOR THE FUTURE 

Ask Supervisor (s) of various Ifevels : 
What plan does this office have for 
developing employees to replace 

those who will leave?. 

How well does the plan work out in 
prac tice? 



How do you spot 'employees with ^ > - 
potential for d/evelopment 
and advancement*? *i i* . .* ^ 

What da.you do about them?* •% , 

'How are employees selected for training 
that is epcpected to lead to . . 
promotion? 

How do yOu make sure th^t other ' \ ... 

qualified employees aren'*t ov&r- ' 
looked?. . "/^;rf , 

How is the progress of trainees ohe'ctecr.' ; . . , 

What happens after they complete 

training ? , , 

What effect,^ if any, do training 

activities have on your agency's 
ability to meet promotion, ex- 
pansion, change-over staffing 
needs? / « , 

Ask seyeral^employees : 

How do employees Ifearn what experience 

and training are required 

for other positions? : ; , 

What guidance and help in self^ 

development is pVovided for 

employees ? • • % ^» • < 

Bo employees here do much on their 

own to qualify themselves for 
.advancement? What kinds of things?...:.. 
What training is given by, the agency 

to help employees qujjify for 

^eater responsibility? ^ 

How do employees get into these 

programs?. . . ♦ . , 

How well does the training work out? 

How many employees ^o complete 

training — pp their own or with 

agency help — get promoted? , 



IMPROVING SUPERVISION 

Ask an experienced supervisor : - 
What does this office expect of you 

as a supervisor? 

Do you have difficulty being this 

kind of supervisor? .' 

What do you do about it? 

What help do you get from youj: chief ?.._...-... . 
What aids to supervisory improvanent 

(e.g. , training courses, guides, special 

news letters) are provided by the agency?. 
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What help, do you get from the training 

staff? : 

How^are you kept up to d^te on things?... 

How often 'do you attend conferences 
with other supervisors in the 
organizati<^n? 

Have you ever. tS^ed out on the joh any 
of "the new sif^ervisory theories and 
practices you have read or heard 
about or seen demonstrated? 

How did they work out? 

What could the agency do that would most 
help you to become a better super- 
visor? 



Ask his superior : 

What do you look for when you select 

a new supervisor? 

How do you judge these things? 

What help do you have in making these 

judgments? 

What do you expect the supervisors- 

res-ponsible to you to do, and what 
do you want them to be like as 
supervisors? 

How do you get this across to them? 

What is done to help them become this 

kirtd of supervisor? 

What assistance an supervisory training 
is given you by .the training staff?.. 

How often do you hold staff conference's 
with tihe supervisors responsible 
to you? ' 

What do ypu discuss then?...^ 

How do they participate? 

Wha-t has been done by this office during 
the past year to improve super- 



vision 
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Ask an employee ? 

How does a person get to be a super- 
visor here.? * 

What kind of person do they seem to 

want the supervisors to be ? . ^ . . . . . . . 

What is done^ to help them become thtt 
/' kind of supervisor? 

How' much information and help on super- 
* visory practices do you^ think they 
receive? - 

What additional help, if any, do you 

think^should be provided? , 
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STRENGTHENING EXECUTIVE LEADERSHIP 

Ask management officials : 

What has yolir organization done to 

analyze its manpower situation?....'.. 
-'What are the general findings and their 

implications for.-fhe future?,.^ 

What is being done about this? 

How current is your inventory of key 

positions and your data on actual* 

and e^rpected losses? 

How do you appraise performance of 

executives? 

What do you do about counselling them?. 
What do you look for when you fill 

executive positions in this 

• organization?...^. 

How are these qualifications judged 

and decisions made? ^ 

How do you Identify executi/e potential? 
What development opportunities — formal - 

and informal — does your agency ''^V . 

provide? 

— for present executives? 

— for potential executives? 

How is executive development tied in 

with recruitment at entrance levels 
and with training at 16ver and 
middle management levels? ^ 

How is it integrated with normal 

operations? . 

To what extent do you feel the executive 
develop'ment program is achieving 
it^ obiectives in improving 
performance in present positions?.., 

— in helping meet promotion, 
expansion, and replacement needs?./. 

Do you have a plan for your own 

development as an executive? 

How well are you able to carry it 

STRENGTHENING PROFESSIONAL LEADERSHIP 

Ask professional employees (in addition 

to pertinent questioi^ listed elsewhere : ) 
H0W does this agency handle attendance 
"^nd participation in professional 

^bciety meetings? 

How often do nonsupervisory professional 
employees go, at agency expense? . .\ • . . . 
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Wmt seminars, lectures, and other 

iprof essional training opportunities 
are available* hefe? ... ^^^^ 

What, provisions are there, for visiting 
' other professional iijstitutions? . . . 

What other steps havfe been taken to/ 
fpster interchange of professional 
information? ' . . 

What has the agency done to promote 
recognition of professional 
achievemenz t?y employees? 
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